Coding Blocks cover image

Technical Challenges of Scale at Twitter

Coding Blocks

00:00

Airflow - Apache Cloud Stack Overflow Infrastructure

Apache Airflow is a platform created by the community program, some word that allows you to offer a schedule and monitor workflows. Apache has so many projects around both OLAP and just like streaming type DAG stuff. Stack overflow uses nine web servers, four SQL servers, two Redis servers. They're putting out 55 terabytes of data a month. It's still super impressive what stack overflow is doing without it. And their homepage loads in 12.2 milliseconds and their questions pages load in 18.3 milliseconds.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app