2min chapter

Data Skeptic cover image

The Right (big data) Tool for the Job with Jay Shankar

Data Skeptic

CHAPTER

AWS AWS - Is This an Ad or a Delete?

The idea was to basically try and move these bursty jobs to AWS. So that you know we can Spawn as many machines as we want on demand and then bring them back down especially with the spot prices sure. The knee of the curve where the so the curves can erratic in the beginning with the smaller files You know the slope is kind of varying and then there's a knee of the Curve and then it just goes straight. That's about 10 million rows you mean the time to process the boss. Very cool.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode