AXRP - the AI X-risk Research Podcast

38.7 - Anthony Aguirre on the Future of Life Institute

Feb 9, 2025

Anthony Aguirre, Executive Director of the Future of Life Institute and UC Santa Cruz professor, dives deep into AI safety and governance. He shares insights on the potential of the AI pause initiative and the importance of licensing advanced AI technologies. Aguirre also discusses how Metaculus influences critical decision-making and the evolution of the Future of Life Institute into an advocacy powerhouse. Explore his thoughts on organizing impactful workshops and supporting innovative projects for a sustainable future.

22:39

Creator website

Episode guests

Anthony Aguirre

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Anthony Aguirre discusses the Future of Life Institute's focus on AI safety and the need for regulatory frameworks to manage transformative technologies.

The importance of clear, well-defined questions in the Metaculus forecasting platform illustrates the value of clarity over prediction accuracy in technological discussions.

Deep dives

Transition from Academia to AI Safety

The speaker emphasizes their transition from a theoretical physics background to a focus on transformative technologies, particularly in artificial intelligence (AI). Approximately 10 years ago, recognizing the future implications of AI, they founded the Future of Life Institute (FLI) with colleagues. This initiative aimed to guide the development of transformative technologies in a safer direction, as early predictions indicated advancements in AI were inevitable, yet unpredictable in terms of their potential risks. Now, as executive director of FLI, the speaker balances their academic responsibilities with their commitment to AI safety and ethical considerations surrounding technology.

Intro

2min

The Birth of Metaculous and Its Impact

5min

Evolution of AI Safety and Advocacy at the Future of Life Institute

4min

Licensing AI: Ensuring Safety and Oversight

8min

Supporting New Organizations for a Sustainable Future

3min

The Future of Life Institute is one of the oldest and most prominant organizations in the AI existential safety space, working on such topics as the AI pause open letter and how the EU AI Act can be improved. Metaculus is one of the premier forecasting sites on the internet. Behind both of them lie one man: Anthony Aguirre, who I talk with in this episode.

Patreon: https://www.patreon.com/axrpodcast

Ko-fi: https://ko-fi.com/axrpodcast

Transcript: https://axrp.net/episode/2025/02/09/episode-38_7-anthony-aguirre-future-of-life-institute.html

FAR.AI: https://far.ai/

FAR.AI on X (aka Twitter): https://x.com/farairesearch

FAR.AI on YouTube: https://www.youtube.com/@FARAIResearch

The Alignment Workshop: https://www.alignment-workshop.com/

Topics we discuss, and timestamps:

00:33 - Anthony, FLI, and Metaculus

06:46 - The Alignment Workshop

07:15 - FLI's current activity

11:04 - AI policy