AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Unsupervised Learning
Ep 58: Google Researchers Noam Shazeer and Jack Rae on Scaling Test-time Compute, Reactions to Ilya & AGI
Mar 17, 2025
Noam Shazeer, co-inventor of the Transformer, and Jack Rae, Research Director at DeepMind, dive into the future of AI. They discuss the groundbreaking capabilities of Gemini 2.0 for reasoning and creativity. The duo explores the complexities of AI evaluation metrics and the evolving role of test-time compute, emphasizing efficiency over traditional methods. They also reflect on the philosophical challenges of AGI, the rise of vision-based models, and AI's transformative impact on healthcare and education, highlighting the balance between innovation and safety.
01:09:28
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Test time compute is pivotal for AI development, impacting model performance and improving reasoning and creative writing capabilities simultaneously.
- The need for meaningful and evolving evaluations in AI modeling is critical, as traditional benchmarks become less relevant as technology advances.
Deep dives
The Role of Test Time Compute in AI Advancement
Test time compute is identified as a crucial aspect of AI development with significant implications for how models operate and improve. The discussion highlights a focus on reasoning tasks, such as math and coding, which initially guided the development of Gemini models. A key surprise was discovering that enhancing thinking processes during training not only benefited reasoning tasks but also improved performance in creative writing, allowing the model to produce entertaining and meaningful content. This multidimensional capability suggests that the integration of reasoning and creativity can lead to more versatile AI applications.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode