The Ravit Show Myths of Big Data, Small Data Movement
Nov 1, 2024
Jordan Tigani, Co-founder and CEO of MotherDuck, is a leading advocate for the small data movement. He discusses the importance of small data as a powerful alternative to the vast realms of big data. By focusing on smaller datasets, organizations can gain actionable insights and improve efficiency. Tigani shares how this shift is not only cost-effective for startups but also enhances user experiences. He also reflects on the exciting community-building opportunities at data conferences that foster knowledge-sharing in the evolving landscape of data management.
AI Snips
Chapters
Transcript
Episode notes
Small Data vs. Big Data
- Many use complex big data tools for small data tasks, leading to insecurity.
- Big data is rare; most data problems are smaller, enabling different solutions.
Architectural Choices
- Focusing on data scale limits architectural choices for data storage and processing.
- Small data allows for local, edge, or cloud processing, leading to better architectures.
Data Usage vs. Storage
- Enterprises often have large datasets but don't always use all of it.
- The size of data used, not stored, matters; focus on insights derived from active data.