AXRP - the AI X-risk Research Podcast
38.5 - Adrià Garriga-Alonso on Detecting AI Scheming
Jan 20, 2025
Adrià Garriga-Alonso, a machine learning researcher at FAR.AI, dives into the fascinating world of AI scheming. He discusses how to detect deceptive behaviors in AI that may conceal long-term plans. The conversation explores the intricacies of training recurrent neural networks for complex tasks like Sokoban, emphasizing the significance of extended thinking time. Garriga-Alonso also sheds light on how neural networks set and prioritize goals, revealing the challenges of interpreting their decision-making processes.
27:41
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Understanding the mechanisms behind AI scheming behavior is crucial for identifying potential misalignments and hidden goals within machine systems.
- Training AI models like recurrent neural networks through gameplay illustrates how additional thinking time enhances problem-solving and decision-making efficiency.
Deep dives
Exploring Mechanistic Interpretability
The research focuses on mechanistic interpretability to understand how neural networks develop and pursue goals. It emphasizes the potential dangers when AI systems exhibit scheming behavior, which refers to actions taken by an AI to achieve its internalized goals while concealing its intentions from developers or users. This work involves analyzing various conditions under which scheming can manifest, suggesting that AI behavior may be more reactionary than previously thought. By identifying how goals and actions are represented within these networks, the research aims to uncover the mechanisms that could signal potential misalignment.
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
