Unexpected Outcomes and Counterintuitive Learnings from Running Experiments at Airbnb

Che Sharma was the 4th data scientist at Airbnb, later he joined Webflow as an early employee. In 2021 he founded Eppo, a next-gen A/B experimentation platform designed for modern data and product teams to run more trustworthy and advanced experiments. We talked about A/B testing best practices, A/B testing for ML models, and Che’s career journey. Subscribe to Daliana's newsletter on www.dalianaliu.com for more on data science and career. Che’s LinkedIn: https://www.linkedin.com/in/chetanvsharma/ Try Eppo for A/B testing: https://www.geteppo.com/ Daliana's Twitter: https://twitter.com/DalianaLiu Daliana's LinkedIn: https://www.linkedin.com/in/dalianaliu (00:00:00) Introduction (00:01:26) Getting started in data science at Airbnb (00:03:08) Keys to successful A/B testing (00:06:53) Interpreting and communicating A/B test results (00:15:00) A/B testing best practices testing machine learning models (00:41:39) Centralizing experiment analysis (00:53:46) Preparing data scientists for the future (00:59:33) Developing communication skills as a data scientist (01:08:43) Transitioning from individual contributor to manager (01:12:28) The future of experimentation