Dwarkesh Podcast cover image

Jeff Dean & Noam Shazeer – 25 years at Google: from PageRank to AGI

Dwarkesh Podcast

CHAPTER

The Evolution of AI Hardware and Algorithms

This chapter explores the progression of artificial intelligence, focusing on the shift from general-purpose CPUs to specialized hardware like TPUs, driven by advancements outlined by Moore’s Law. It discusses the relationship between hardware capabilities and algorithm evolution, including the implications of memory and arithmetic costs. Additionally, the chapter recounts the development of Google’s machine translation system, highlighting engineering optimizations and the humorous legacy of Jeff Dean in the tech community.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner