Each opening each one of those takes a few, maybe 204 hundred, 500 mill seconds. You might open up all 20 million files and then look at but it's meditatus is an ray. So we're able to very quickly stack these together into this x ray data ray that's fairly small since we've chopped it down. Once you get what you just call data do persist on the thea dask array, you just see in the dashboard of dask,. like all these clusters firing up and all this data getting processed and e up exactly.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode