

Big data is dead, analytics is alive
20 snips Oct 24, 2024
Till Döhmen, a key contributor at MotherDuck, and Kurt Mackey, CEO of Fly.io, discuss the evolution of analytics beyond the big data hype. They highlight DuckDB's ability to execute rapid analytics queries on local machines, transforming data workflows. The conversation touches on AI's intersection with analytics, exploring topics like text-to-sql and vector search. They also emphasize DuckDB's role in enhancing workflows for data scientists and how it competes with traditional cloud services, offering simpler and more efficient solutions.
AI Snips
Chapters
Transcript
Episode notes
DuckDB's surprising speed
- Adithya Krishnan initially dismissed DuckDB's speed on a 100MB dataset as an error.
- His prior Spark experience made him expect significant delays, highlighting DuckDB's performance.
Geospatial analytics in the browser
- Till Döhmen's first encounter with DuckDB involved its Wasm version and geospatial analytics in the browser.
- The ability to perform such complex analysis client-side amazed him.
Challenging Big Data
- DuckDB challenges the traditional big data paradigm by enabling complex analysis on local machines and browsers.
- It leverages in-process architecture and vectorized columnar query execution.