Feedback-Loop and Exploration Methods you own this product

intermediate Python data science libraries • intermediate machine learning • intermediate recommender system experience (specifically Two Towers) • basics of developing an ML pipeline, Intermediate TensorFlow 2.x
skills learned
rerank a list of items after a model already predicted their rankings • add noise to the model to affect predictions as they’re made • combine lists with different rankings to increase traffic to lower ranking items • use a Feature Store as part of a prediction pipeline
Shaked Zychlinski
1 week · 4-6 hours per week · ADVANCED

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases

lite $19.99 per month

  • access to all Manning books, including MEAPs!


5, 10 or 20 seats+ for your team - learn more

Look inside

Since recommender systems train and learn over the data they recommended themselves, they will never train over, learn, or recommend items that they didn’t already recommend for some reason, such as insufficient ranking to be seen by the user. It’s important to break this Feedback Loop in order to ensure that suitable recommendations aren’t missed. But you must strike a balance between deviating (just enough) from the system’s predictions through exploration and not defeating the system’s purpose altogether. In this liveProject, you’ll learn three methods of exploration that help you provide better recommendations to your users, as well as the costs and benefits of each.

This project is designed for learning purposes and is not a complete, production-ready application or solution.

project author

Shaked Zychlinski

Shaked is currently leading the recommendation research group and company’s recommendations efforts at Lightricks, developing the company's RS algorithms from the ground up. Prior to this, he worked at and led projects at the Algo group of Taboola, one of the largest content recommendation companies in the world. He is a featured writer on Towards Data Science, with hundreds of reads each day. He has also developed the Dython library for Python, with 26k (and counting) downloads a month.


This liveProject is for data scientists with theoretical knowledge of machine learning, deep learning, and recommender systems who want to take the next step in their career. To begin these liveProjects you will need to be familiar with the following:

  • Intermediate Python (NumPy, pandas, Matplotlib)
  • Intermediate scikit-learn
  • Basics of TensorFlow 2.x (Keras interface)
  • TensorFlow Recommenders (retrieval and ranking models)
  • Basic linear algebra (vectors, spaces, matrix transformations)
  • Define, train, and evaluate models


You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.

choose your plan


only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Feedback-Loop and Exploration Methods project for free