3min snip

80,000 Hours Podcast cover image

#194 – Vitalik Buterin on defensive acceleration and how to regulate AI when you fear government

80,000 Hours Podcast

INSIGHT

Polytheistic AI: Stability Concerns

A polytheistic AI approach, where multiple AIs exist across countries, companies, and individuals, is proposed as a safer alternative to a single, centralized AI. This distribution of power aims to prevent global takeover by any single entity. While seemingly stable from traditional political theory, the inherent instability of this model is discussed, particularly due to the potential for one AI to rapidly advance and surpass others.

Skepticism of Centralized AI: "...something that would be appealing is you might delay militarization of AI because people would feel like countries would feel less competitive pressure to suddenly insert AI into all parts of their military..."

Polytheistic AI: "...we don't try to create a global singleton. We tried to, it's like an AI for every country and then possibly an AI for every company and every individual."

Distributed Agency: "...the agency in the AI is widely distributed because they have so many AIs controlled by so many different people, then there's no one single actor that's actually able to take over the world."

Instability Concerns: "...with super intelligent AI, it feels like it's an equilibrium that could easily be very unstable."

Rapid Advancement Potential: "...whoever first discovers like some magic leap, which could be discovery of nanotechnology, [...] would be able to just like immediately turn on that improvements. And then they'd quickly expand and quickly be able to find milk, all of the, uh, other possible improvements before anyone else."

The potential for rapid, uneven advancement among AIs in a polytheistic model poses a significant risk to its stability, potentially leading to dominance by a single, advanced AI despite initial distributed control.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode