Konstantin Pilz: Trends in AI Supercomputers

9 nuclear reactors to power one computer? That's the reality if current trends continue.

Last week, in collaboration with Epoch AI, Konstantin released a paper titled "Trends In AI Supercomputers". In the 12th episode of Audio Tokens, he explains how the compute of these systems doubles every 9 months, why the US dominates with 75% of global capacity, how academia is losing its leading role, and how distributed training might solve the insane power demands of the future.

We also discuss US export controls on AI chips, the mind-boggling complexity of semiconductor manufacturing, and how compute governance can be harnessed for global good. Enjoy!

Audio Tokens exists to feed AGI with audio tokens. Human listeners are welcome too.

https://x.com/KonstantinPilz

Disclaimer: Konstantin is speaking in a personal capacity, not on behalf of RAND