The Product Podcast cover image

Intro to A/B Testing by Ever's Senior PM

The Product Podcast

00:00

How Long Will Your Experiment Take to Run?

If you're trying to improve registration rate and that's 50%, then your baseline conversion would be 50%. The second variable is minimum detectable effect. So we want to see at least a 0.5, we only care about differences greater than 0.5%. And that's kind of the basis of our experiment. Now, if your minimum detectable effect is smaller, your sample size will end up being larger,. If you want to detect a 0.01% change, you're going to need a huge sample size. But if you want to detects a 5% change, it's going to be much smaller.

Play episode from 14:43
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app