

David J. Hand, "Dark Data: Why What You Don't Know Matters" (Princeton UP, 2020)
Jul 8, 2024
David J. Hand, author of "Dark Data: Why What You Don't Know Matters," dives into the fascinating world of unseen data. He discusses how traditional statistics often overlook vital uncollected information, which can skew understanding. With intriguing case studies, he illustrates the real-world implications of dark data, from polling inaccuracies to fraud detection challenges. Hand emphasizes the need for refined data collection strategies and how recognizing dark data can transform decision-making and analytical methods, particularly in machine learning.
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7
Intro
00:00 • 2min
Navigating Dark Data: A Statistician's Journey
02:27 • 15min
Understanding Data Collection Strategies: Census, Survey, and Experiment
17:22 • 4min
Misconceptions and Challenges in Data Analysis
21:25 • 18min
Distortion of Measures: Campbell and Goodhart
39:11 • 5min
The Dark Dance of Fraud and Prevention
44:13 • 24min
Unveiling Dark Data and Its Impact
01:07:47 • 9min