
The Right (big data) Tool for the Job with Jay Shankar
Data Skeptic
00:00
AWS AWS - Is This an Ad or a Delete?
The idea was to basically try and move these bursty jobs to AWS. So that you know we can Spawn as many machines as we want on demand and then bring them back down especially with the spot prices sure. The knee of the curve where the so the curves can erratic in the beginning with the smaller files You know the slope is kind of varying and then there's a knee of the Curve and then it just goes straight. That's about 10 million rows you mean the time to process the boss. Very cool.
Transcript
Play full episode