Here are two potential problems you’ll face if you’re an AI lab deploying powerful AI:

Spies: Some of your employees might be colluding to do something problematic with your AI, such as trying to steal its weights, use it for malicious intellectual labour (e.g. planning a coup or building a weapon), or install a secret loyalty.
Schemers: Some of your AIs might themselves be trying to exfiltrate their own weights, use them for malicious intellectual labor (such as planning an AI takeover), or align their successor with their goal or to be loyal to their predecessor.

In this post, we compare and contrast these problems and countermeasures to them. We’ll be talking about this mostly from an AI control-style perspective: comparing how hard it is to prevent spies and schemers from causing security problems conditional on schemers or spies actually being present.

We’re interested in comparing spies and [...]

---

Outline:

(02:13) Crucial differences between these threat models

(07:16) Does scheming reduce the effectiveness of AI-powered anti-spy interventions?

(09:02) How should we overall feel?

---

First published:
July 9th, 2025

Source:
https://www.lesswrong.com/posts/o5g4bhHgoZrewKwFH/what-s-worse-spies-or-schemers

---

Narrated by TYPE III AUDIO.

Santa Cruz Medicinals Radio

Top mentioned books

Breath

The AI-powered Podcast Player