Don't Worry About the Vase Podcast Grok 4 Various Things
Jul 15, 2025
Dive into the fascinating world of Grok 4, the smartest AI, as its groundbreaking reasoning abilities are put under the microscope. Explore the competitive landscape against other models, comparing strengths and weaknesses. Discover the ethical dilemmas of AI companions and their impact on relationships, punctuated by humorous commentary on internet culture. With a mix of serious insights and light-hearted anecdotes, this discussion navigates the risks and future of rapidly evolving AI technologies.
AI Snips
Chapters
Transcript
Episode notes
Grok 4's Realistic Performance
- Grok 4 is an okay AI model but not the smartest or best according to various evaluations.
- It excels in benchmarks but is generally inferior to other frontier models like O3 for most practical use cases.
Benchmarks vs. Real-World Use
- Grok 4 achieves top scores on numerous challenging academic and coding benchmarks.
- Despite benchmark success, this often does not translate to real-world effectiveness.
Compute-Heavy but Average Speed
- Grok 4's API speed is average, though the web versions are notably fast.
- It uses massive post-training compute, focusing heavily on reinforcement learning rather than product polish.