The Joe Reis Show Jordan Tigani - Why Small Data is Awesome, DuckDB, and More
5 snips
Sep 5, 2024 Jordan Tigani, a data expert and co-founder of Motherduck, dives into the diverse world of small data and the innovative DuckDB. He highlights the overlooked value of small data, advocating for its practical applications over big data hype. Tigani shares insights on DuckDB’s flexibility, performance, and ease of use, making data management more accessible. The conversation also touches on AI's transformative role in data roles and the complexities of revenue calculation in SaaS, emphasizing the need for a thoughtful approach to data analytics.
AI Snips
Chapters
Transcript
Episode notes
Small Data Reality Check
- Most data users do not operate on massive data sizes; the focus should be on efficient interaction with smaller datasets.
- Benchmark metrics for huge-scale data like 100 TB are irrelevant for typical workloads and distort the industry focus.
Big Data Is Usage Not Size
- Big data is about how data is used, not just size; querying small slices of large datasets is common.
- Proper data partitioning allows efficient analysis without requiring big data tools for every query.
DuckDB's Versatile Use Cases
- DuckDB is used in diverse ways, including as a JSON parser and for server-side file format translation.
- It enables fast interactive data exploration and powers data analysis right from laptops or even browsers.