

878: In Case You Missed It in March 2025
23 snips Apr 11, 2025
Andriy Burkov, an acclaimed author and AI developer, teams up with Varun Godbole, a former Google engineer who contributed to the Gemini model. They dive into artificial general intelligence, discussing the cognitive skills of animals and their implications for AI development. The conversation highlights a tuning playbook for neural networks, emphasizing the challenges of hyperparameter tuning. They also explore the need for human connection in AI and innovative approaches for enhancing machine learning education and experimentation.
AI Snips
Chapters
Books
Transcript
Episode notes
Infinite Horizon Planning
- Humans plan over an infinite horizon, unlike other animals who have limited planning abilities.
- LLMs lack this crucial ability, making them reactive rather than truly agentic.
Fabricated Book Reviews
- Andriy Burkov tested OpenAI's O3 Mini by asking about his lesser-known third book.
- The model fabricated positive reviews based on his reputation, highlighting LLMs' inability to discern knowledge gaps.
Embracing Humanness
- Natalie Monbiot suggests embracing uniquely human skills and experiences in the age of AI.
- AI lacks embodiment and embeddedness in the world, making human experience irreplaceable.