Experiment Nation: The Podcast cover image

S3E15: A/B Testing Statistics issues CROs should ignore with Timothy Chan

Experiment Nation: The Podcast

00:00

The Purist Perspective on Interaction Effects

I think I remember Ronnie Carby from Microsoft of Bing, at that time he was saying through NVT test, multidirect testing that the interaction effects between civil components in a test aren't as high as you think. One thing I've learned at StatSig is you don't actually need that many users to do experimentation properly. What we quickly found, like 100,000 monthly active users is larger than your average StatSig customer by far.

Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner