Dwarkesh Podcast cover image

Jeff Dean & Noam Shazeer – 25 years at Google: from PageRank to AGI

Dwarkesh Podcast

00:00

The Evolution of AI Hardware and Algorithms

This chapter explores the progression of artificial intelligence, focusing on the shift from general-purpose CPUs to specialized hardware like TPUs, driven by advancements outlined by Moore’s Law. It discusses the relationship between hardware capabilities and algorithm evolution, including the implications of memory and arithmetic costs. Additionally, the chapter recounts the development of Google’s machine translation system, highlighting engineering optimizations and the humorous legacy of Jeff Dean in the tech community.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app