AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Monday Morning Data Chat
#128 - Big & Small Data in 2023 w/ Joe Reis & Matt Housley
May 29, 2023
Debate between big and small data in 2023. Exploration of AI and ML, massive LLMs vs. small data alternatives. Will Big Data reign supreme or will small data become more popular?
01:00:41
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- The podcast debates the future dominance of big data over small data in data engineering and AI landscapes.
- Training and maintaining large language models pose significant costs and doubts regarding competitive advantages, emphasizing data quality.
Deep dives
Evolution of Big Data and Google File System
The podcast delves into the evolution of big data, starting from the late '90s with search engines like Altavista and Google File System (GFS) in MapReduce. The discussion highlights how companies like John King's, facing large data problems back in the mid-2000s, needed tools like Hadoop to process vast amounts of data. It touches on the hype surrounding big data, shifting focus from technologies to data sizes, and reflects on current definitions of data scalability and complexity.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode