Office Hours with Tomasz Tunguz Office Hours with Jordan Tigani: Modern Data Architectures
8 snips
May 6, 2024 Discussion on the death of Big Data, hybrid architectures, using large language models for onboarding, DuckDB for ETL, and the role of humor in building a startup brand
AI Snips
Chapters
Transcript
Episode notes
Big Data Hype vs Reality
- Jordan's experience at Google BigQuery showed most customers query very small datasets under 100MB.
- This contradicted the big data hype, leading him to write "big data is dead."
Ease of Use Is Critical
- Ease of use is critical for database adoption today.
- DuckDB stands out by allowing instant querying of data with minimal setup, unlike many complex big platforms.
Hybrid Execution Simplifies Scaling
- Hybrid execution allows seamless scaling from local to cloud datasets.
- Users can join local and cloud data transparently, easing scaling and collaboration.