Hard Software Hard Software Episode 9: Is Big Data Dead? with Jordan Tigani, CEO @ MotherDuck
Apr 22, 2025
AI Snips
Chapters
Transcript
Episode notes
Reality of Big Data Usage
- Most users of BigQuery actually query very small datasets, with 90% of queries operating on less than 10MB.
- Architectural designs for big data need reevaluation as modern hardware and networks have changed capabilities and costs.
Redefining Big Data Today
- Big data was traditionally defined as data too large for a single machine, but modern machines can handle much larger workloads.
- Separating storage from compute enables processing smaller data chunks while storing petabytes remotely.
Big Data is Dead Insight
- Big data is dead because most users don't have massive datasets and there's imposter syndrome about small data.
- AI trends also point toward doing more with less data, smaller models, and less hardware.