
Intro to A/B Testing by Ever's Senior PM
The Product Podcast
00:00
Six Common Ways to Invalidate an Experiment
Be aware of all the common ways you can potentially invalidate one of your experiments. Number one is insufficient sample size like we talked about. Number two is insufficient time. If you have multiple experiments running that are dealing with the exact same experience, maybe there's some overlap that you have to consider when you're looking at your results. Outlier, outlier events like holidays, if you're doing tests during December, people have much higher purchasing power. And that might affect how they interact with the variables that you're testing.
Play episode from 40:14
Transcript


