Coding Blocks cover image

Technical Challenges of Scale at Twitter

Coding Blocks

00:00

BigQuery - Data Proc, Data Flow, and Performance?

Apache Beam was a language behind Spark. It allowed you to do like data streaming type things in a managed pipeline that you didn't really have to mess with, right? You write the code and it would run it for you. Naming's hard, right? Yeah, not for sure. Even for infrastructure and services. No, I've got some badly named variables all over the place. So this is a big one. Like, hey, if you're going to try and get a bunch of people to buy into your platform, it probably needs to work well.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app