EA Forum Podcast (All audio) [Linkpost] “AI Governance to Avoid Extinction: The Strategic Landscape and Actionable Research Questions [MIRI TGT Research Agenda]” by peterbarnett, Aaron_Scher
We’re excited to release a new AI governance research agenda from the MIRI Technical Governance Team. With this research agenda, we have two main aims: to describe the strategic landscape of AI development and to catalog important governance research questions. We base the agenda around four high-level scenarios for the geopolitical response to advanced AI development. Our favored scenario involves building the technical, legal, and institutional infrastructure required to internationally restrict dangerous AI development and deployment (which we refer to as an Off Switch), which leads into an internationally coordinated Halt on frontier AI activities at some point in the future. This blog post is a slightly edited version of the executive summary.
We are also looking for someone to lead our team and work on these problems, please reach out here if you think you’d be a good fit.
The default trajectory of AI [...]
---
Outline:
(04:48) Off Switch and Halt
(07:37) US National Project
(09:53) Light-Touch
(12:07) Threat of Sabotage
(14:27) Understanding the World
(15:11) Outlook
---
First published:
May 5th, 2025
Linkpost URL:
https://techgov.intelligence.org/research/ai-governance-to-avoid-extinction
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.