

The Breakthroughs Needed for AGI Have Already Been Made: OpenAI Former Research Head Bob McGrew
573 snips Jun 17, 2025
Bob McGrew, former Head of Research at OpenAI, shares insights on AI's rapid evolution. He discusses the three essential pillars for artificial general intelligence: Transformers, scaled pre-training, and reasoning. McGrew predicts that 2025 will focus on reasoning as pre-training stagnates. He highlights how the agent economy will disrupt industries, including law and medicine, due to an abundance of AI services. Personal anecdotes reveal how his children use ChatGPT to fuel their curiosity, while he also explores opportunities for startups in AI and robotics.
AI Snips
Chapters
Transcript
Episode notes
Three Legs of AGI
- The three legs of AI for AGI are transformers, scaled pre-training, and reasoning.
- 2025 will be defined by reasoning advancements, while pre-training hits diminishing returns.
Pre-training Hits Diminishing Returns
- Pre-training exhibits diminishing returns due to log-linear scaling with compute.
- Major jumps require years and new data centers, shifting pre-training’s role to architecture improvement.
Post-training Crafts AI Personality
- Post-training shapes model personality rather than intelligence.
- It requires human effort and deep understanding of human nature to craft appealing AI personalities.