AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Power Distribution of a Single Test
In most cases, you really want to have more than 30% power there for 4% lift. Small changes like this are very unlikely to result in meaningful differences. Most practitioners understand that unless they have a drastically different variant, which has sort of an independent chance of being better than both the control and their first variant, then adding the variant seriously.