
Technical Challenges of Scale at Twitter
Coding Blocks
00:00
Airflow - Apache Cloud Stack Overflow Infrastructure
Apache Airflow is a platform created by the community program, some word that allows you to offer a schedule and monitor workflows. Apache has so many projects around both OLAP and just like streaming type DAG stuff. Stack overflow uses nine web servers, four SQL servers, two Redis servers. They're putting out 55 terabytes of data a month. It's still super impressive what stack overflow is doing without it. And their homepage loads in 12.2 milliseconds and their questions pages load in 18.3 milliseconds.
Transcript
Play full episode