Experiment Nation: The Podcast S3E15: A/B Testing Statistics issues CROs should ignore with Timothy Chan
15 snips
May 5, 2023 Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
Introduction
00:00 • 3min
The Role of a Data Scientist in Facebook's Growth
02:47 • 3min
Facebook's Democratization of Experimentation
05:42 • 2min
How Facebook Approached QA and Experimentation
07:24 • 3min
How a Data Scientist Influenced Experimentation
10:43 • 2min
Facebook's Culture of Overlapping Tests
13:11 • 3min
The Purist Perspective on Interaction Effects
16:23 • 2min
How to Succeed at Facebook's Scale Experiment
18:01 • 3min
How to Measure CRO Performance With Minimum Sample Size
20:48 • 2min
The Power of Experimentation at Facebook
22:56 • 2min
How to Join a Startup
25:05 • 2min
The Data Scientist's Perspective on Statistics
26:41 • 2min
How Facebook's Stats Engine Works
28:20 • 5min
How to Set a Custom Confidence Interval
32:50 • 3min
The Effects of Testing on False Positives
35:25 • 2min
The Cost of Making a Change on a Website
37:38 • 3min