

A/B testing and growth analytics at Airbnb, building data science tools and metrics store with Nick Handel, the data scientist show#037
May 24, 2022
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44
Introduction
00:00 • 3min
What's the Day to Day Like as a Data Analyst in Black Rock?
03:06 • 3min
How Did You Get to AirBeand Be?
05:48 • 3min
Data Science Tools, the Experimentation Framework?
08:57 • 3min
What Are Common Mistakes People Make With Product Experiments?
11:56 • 3min
Cannibalization
14:40 • 2min
The Power of Product Experiments
16:55 • 2min
Is the Unit of Experimentation Standardized?
19:07 • 2min
Do We Really Need to Log People Out After 40 Hours?
21:34 • 4min
Is There a Framework for Data Science?
25:28 • 3min
Data Science - How to Avoid Random Hypotheses That Are Meaningless?
28:30 • 2min
How to Build Trust in the Data Science Industry
30:06 • 5min
Yen, You Don't Read It All.
35:17 • 2min
Logging Experiments Are Impacting Customer Service Tickets
37:34 • 3min
Do You Coordinate?
40:17 • 2min
The Biggest Surprising Thing About Ab Testing?
42:05 • 4min
Is There a Good Culture of Experimentation?
46:16 • 2min
You'll Learn Something From It
48:27 • 5min
Using Event Logging to Analyze Data
53:17 • 4min
Machine Learning at Arbanby - What's the Story?
57:07 • 3min
Machine Learning and Events - A Great Case Study
59:40 • 4min
Machine Learning Models - How Do You Know if You're Not Missing Something?
01:03:58 • 6min
Arn Beand B - How to Scale for Different Use Cases
01:09:57 • 2min
Using Python in Machine Learning Models?
01:12:12 • 1min
Building Tooling Is Really Hard, Is It?
01:13:41 • 2min
Scaling a Business
01:15:33 • 2min
Build a Tool - What Are Some Other Important Decisions You Made?
01:17:05 • 2min
Machine Learning - What's the Future Store?
01:19:05 • 3min
A Data Scientist's Perspective on Machine Learning and Machine Learning
01:21:50 • 2min
Data Engineering - The Hard Part Was Generalization, Right?
01:23:55 • 5min
Transform Is a Metric That Is the Language for Data.
01:28:47 • 2min
Using a Semantic Layer for Machine Learning?
01:30:30 • 3min
Are You Building a Reporting Tool?
01:33:41 • 4min
Is There a Future for Data Science Tools?
01:37:59 • 5min
Machine Learning
01:42:45 • 2min
Metric Flow
01:44:30 • 3min
Is It Really Important to Generate Metrics for Product Experiments?
01:47:21 • 3min
What Are Some of the Lessons You Learned From Data Science?
01:50:24 • 4min
Don't Follow the Formula, Do Sandwich?
01:53:54 • 3min
Are You Making These Mistakes as a Data Scientist?
01:56:36 • 3min
The One Example of the Industry Is Missing
02:00:00 • 2min
What Do You Learn From Your Brother?
02:02:08 • 2min
I've Learned a Lot From My Co-Fender
02:03:47 • 3min
Are You Planning a Wedding Already?
02:06:49 • 3min