Coding Blocks cover image

Technical Challenges of Scale at Twitter

Coding Blocks

00:00

Did They Recreate Presto or Drill?

Twitter's Dow allows users to annotate data sets with privacy information. Users can also specify retention for scrubbing where you're evaluating the performance and cost of two things. This goes back to our Presto drill conversation from earlier. We use schedule jobs to enumerate BigQuery data sets and register them with the data access layer. So that's, you know, part of it, um, which is Twitter's metadata store.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app