Center for AI Policy Podcast #16: Gabe Alfour on Competing Beliefs About Superintelligence
Apr 9, 2025
Gabe Alfour, Chief Technology Officer at Conjecture, dives into the fascinating realm of superintelligence and AI alignment. He shares intriguing views on how AI can potentially transform scientific progress and raise ethical concerns. Alfour discusses the risks of losing control over AI technologies and the importance of international cooperation to establish governance frameworks. He also addresses the necessity of safety measures like kill switches to prevent rogue AI actions, all while exploring the balance between rapid innovation and responsible oversight.
AI Snips
Chapters
Books
Transcript
Episode notes
Meaning of Superintelligence
- "Superintelligence" means AI surpassing all humans combined.
- Sam Altman refers to AI controlling vast future value, implying extreme power.
Limits and Risks of Technology
- Technology progress far from limits, leaving room for drastic advancements.
- Superintelligent AIs may autonomously develop powerful weapons with no human oversight.
Technology Compounds Over Time
- Technological progress accelerates through better science and education.
- Technologies compound, approaching physical limits, ensuring continued advancement.
