
The Every Podcast We Taught AI to Play Games—Now It’s a $3.6 Million Company
348 snips
Oct 15, 2025 Join Alex Duffy, the Head of AI Training and brains behind Good Start Labs, as he discusses the innovative role of games in training AI models. He reflects on lessons learned from games like RuneScape and reveals why traditional testing benchmarks are outdated. By using games like Diplomacy, Alex showcases how AI can develop negotiation skills and strategic thinking. He also shares insights on the future of AI in fields like education and life sciences, emphasizing how gaming can demystify AI for the public.
AI Snips
Chapters
Books
Transcript
Episode notes
Design The Model Interface Holistically
- Treat model interfaces as an instrument across three design axes: representation, tools, and prompt.
- Iterate on all three to find effective, model-specific solutions.
Use Tournaments To Discover Prompts
- Run prompting tournaments to explore the prompt/design search space collaboratively.
- Let locked-in prompts compete to reveal which strategies and prompters win in practice.
Games Are Eval And Training Labs
- Games serve as both evaluation and training environments, letting you measure and improve models iteratively.
- Carefully chosen games target specific model weaknesses and generalize to other tasks.





