Experiment Nation: The Podcast cover image

S3E15: A/B Testing Statistics issues CROs should ignore with Timothy Chan

Experiment Nation: The Podcast

00:00

How to Succeed at Facebook's Scale Experiment

I was used to Facebook's scale experiment, and I had worked at small products at Facebook. And so I would see these small companies, and not only that, these folks didn't have a ton of experience with experimentation - they were just getting started. But what I had quickly learned is that most of these companies who are startups ended up succeeding. They ended up with these wildly impressive results,. like plus 50% wins, plus 80% wins, and it happened very routinely. So I think it's a myth that you need large sample sizes to do experimentation.

Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner