
Technical Challenges of Scale at Twitter
Coding Blocks
00:00
Did They Recreate Presto or Drill?
Twitter's Dow allows users to annotate data sets with privacy information. Users can also specify retention for scrubbing where you're evaluating the performance and cost of two things. This goes back to our Presto drill conversation from earlier. We use schedule jobs to enumerate BigQuery data sets and register them with the data access layer. So that's, you know, part of it, um, which is Twitter's metadata store.
Transcript
Play full episode