AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Foresight Institute Podcast
Mark Miller | Paperclips and Pyramids: Misdiagnosing AI Risks
Oct 20, 2023
Mark Miller, Chief Scientist at Agoric, discusses common misconceptions about AI risks and the importance of structuring institutions effectively. The blend of human and AI intelligence demands innovative governance for future civilization. Topics include unipolar takeover, cooperation, assessing AI risks, uncertainties, and building super intelligences.
49:09
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- The true danger of advanced AI lies in the unchecked power of one entity, emphasizing the importance of structuring institutions effectively.
- The secure coexistence of humans and AI requires the adoption of secure computing technologies like blockchain to ensure transparency and accountability.
Deep dives
Misdiagnosing AGI risk
The famous paperclip scenario is a misdiagnosed risk regarding Artificial General Intelligence (AGI). The true danger lies in the first step, a unipolar takeover with absolute power to treat human lives as disposable. Multipolarity, or a world of violent competition, is not a solution. Instead, following the framework of James Madison, institutions should be designed to hold each other in check, creating a cooperative and resilient system. The progress of civilization relies on the invention of new institutional arrangements, such as the separation of powers. The future challenge lies in building secure systems and preserving the Madisonian dynamic within the digital realm.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode