AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
3min chapter
What Does Apache Arrow Unlock for Analytics? (w/ Wes McKinney)
The Analytics Engineering Podcast
Why Data Work Is Slow?
There's a couple main components to why stuff is slow, like why data work is slow. I think there are two big ones: disk access reading, writing from disk and maybe important in this context is like converting between memory formats. And so let's say that you take the earlier two categories and you like zero them out, they're like gone. You still have to fight with the network, right? And then you're fighting with the laws of physics. So if arrow is taking a big chunk out of this other section of things, is it only a small percentage? It can be a big part.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode