The Product Podcast cover image

Intro to A/B Testing by Ever's Senior PM

The Product Podcast

00:00

Six Common Ways to Invalidate an Experiment

Be aware of all the common ways you can potentially invalidate one of your experiments. Number one is insufficient sample size like we talked about. Number two is insufficient time. If you have multiple experiments running that are dealing with the exact same experience, maybe there's some overlap that you have to consider when you're looking at your results. Outlier, outlier events like holidays, if you're doing tests during December, people have much higher purchasing power. And that might affect how they interact with the variables that you're testing.

Play episode from 40:14
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app