The Importance of A/B Testing in Machine Learning Models

Che Sharma was the 4th data scientist at Airbnb, later he joined Webflow as an early employee. In 2021 he founded Eppo, a next-gen A/B experimentation platform designed for modern data and product teams to run more trustworthy and advanced experiments. We talked about A/B testing best practices, A/B testing for ML models, and Che’s career journey. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Che’s LinkedIn: https://www.linkedin.com/in/chetanvsharma/ Try Eppo for A/B testing: https://www.geteppo.com/ Daliana's Twitter: https://twitter.com/DalianaLiu Daliana's LinkedIn: https://www.linkedin.com/in/dalianaliu (00:00:00) Introduction (00:01:26) Getting started in data science at Airbnb (00:03:08) Keys to successful A/B testing (00:06:53) Interpreting and communicating A/B test results (00:15:00) A/B testing best practices testing machine learning models (00:41:39) Centralizing experiment analysis (00:53:46) Preparing data scientists for the future (00:59:33) Developing communication skills as a data scientist (01:08:43) Transitioning from individual contributor to manager (01:12:28) The future of experimentation