Coding Blocks cover image

Technical Challenges of Scale at Twitter

Coding Blocks

00:00

Is That a High Sensitivity Data Set?

There were additional costs associated with storing data in GCS and BigQuery. In some situations when they're querying tens of petabytes of data, it was more cost effective to use PrestoDB than to use the GCS storage and Big query. For a lot of people that want to use BigQuery, that's probably worth it because you're looking for that processing power. And there was one very interesting situation that I find extremely curious and I'd love to know more about it but they just put a line in here.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app