
S3E17 - CRO Insights from a Metaanalysis of over 1000 A/B Tests with Georgi Georgiev
Experiment Nation: The Podcast
00:00
The Power Distribution of a Single Test
In most cases, you really want to have more than 30% power there for 4% lift. Small changes like this are very unlikely to result in meaningful differences. Most practitioners understand that unless they have a drastically different variant, which has sort of an independent chance of being better than both the control and their first variant, then adding the variant seriously.
Transcript
Play full episode