
Technical Challenges of Scale at Twitter
Coding Blocks
00:00
BigQuery - Data Proc, Data Flow, and Performance?
Apache Beam was a language behind Spark. It allowed you to do like data streaming type things in a managed pipeline that you didn't really have to mess with, right? You write the code and it would run it for you. Naming's hard, right? Yeah, not for sure. Even for infrastructure and services. No, I've got some badly named variables all over the place. So this is a big one. Like, hey, if you're going to try and get a bunch of people to buy into your platform, it probably needs to work well.
Transcript
Play full episode