ildar safilo
- Machine Learning Scientist in the Booking.com
- Experienced manager in MLE/DS/SE/DA, I possess extensive expertise in machine learning, analytics, and software engineering. I excel at leading teams to create groundbreaking businesses and delivering innovative solutions for real-world business cases across various industries, including IT, banking, telecommunications, marketplaces, game development, shops, Travel-tech and streaming platforms.
- Expert in building recommendation and ranking systems, as well as personalization automation with machine learning, and advanced A/B testing.
- Co-author and lecturer of a popular online course on recommender system development with over 1000 students.
- Co-author an open-source Python library called RecTools, specifically designed for building recommender systems. The library is hosted on GitHub at RecTools and has received widespread recognition and adoption in the industry.
- Graduate with a Master’s degree in Mathematics and Computer Science and over 6 years of experience in data science.
Sessions
09-15
13:00
30min
Mastering Recommendation Systems Evaluation: An A/B Testing Approach with Insights from the Industry
ildar safilo
Recommendation systems shape personalized experiences across various sectors, but evaluating their effectiveness remains a significant challenge. Drawing on experiences from industry leaders such as Booking.com, this talk introduces a robust, practical approach to A/B testing for assessing the quality of recommendation systems. The talk is designed for data scientists, statisticians, and business professionals, offering real-world insights and industry tricks on setting up A/B tests, interpreting results, and circumventing common pitfalls. While basic familiarity with recommendation systems and A/B testing is beneficial, it's not a prerequisite.
Qux