Experiment Nation: The Podcast

S3E17 - CRO Insights from a Metaanalysis of over 1000 A/B Tests with Georgi Georgiev

May 20, 2023
Ask episode
Chapters
Transcript
Episode notes
1
Introduction
00:00 • 3min
2
The Importance of Analyzing Results
03:06 • 3min
3
How to Be an Expert in Statistical Methods
06:05 • 2min
4
The Importance of Deep Diving in A.B. Testing
08:30 • 3min
5
The Evolution of Analytics
11:47 • 3min
6
The Consequences of Running Tests Longer
14:21 • 6min
7
The Importance of Concurrent Tests
20:10 • 6min
8
The Importance of 80% Power in Testing
25:49 • 3min
9
The Power Distribution of a Single Test
28:30 • 6min
10
The Risk of Losses in A.B. Tests
34:13 • 6min
11
The Importance of Sequential Testing
39:47 • 6min
12
The Relationship Between Bandits and Equation Tests
45:23 • 3min
13
The Benefits of Running a Test Early
48:22 • 4min
14
The Importance of Minimum Effective Interest in Tests
52:18 • 6min
15
How to Be a Successful Statistician
57:55 • 3min