4min snip

The Joe Reis Show cover image

Jordan Tigani - Why Small Data is Awesome, DuckDB, and More

The Joe Reis Show

NOTE

Small Data Can Be Mighty

Measuring database performance based on user experience emphasizes the importance of query response times rather than absolute speed differences between systems. Users prioritize responsiveness, such as the number of queries executing in under a second, over minute variations in performance. A study of half a billion queries on Redshift reveals that many users do not work with massive datasets; even those with large datasets often query only small portions. This indicates that advanced systems may not be necessary for typical user tasks. With the modern separation of storage and compute, effective data handling can occur without extensive computational resources for small data inquiries. The emerging interest in small data demonstrates its significance in current data practices, leading to events that celebrate its value.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode