
Technical Challenges of Scale at Twitter
Coding Blocks
00:00
Is That a High Sensitivity Data Set?
There were additional costs associated with storing data in GCS and BigQuery. In some situations when they're querying tens of petabytes of data, it was more cost effective to use PrestoDB than to use the GCS storage and Big query. For a lot of people that want to use BigQuery, that's probably worth it because you're looking for that processing power. And there was one very interesting situation that I find extremely curious and I'd love to know more about it but they just put a line in here.
Transcript
Play full episode