AI Safety Fundamentals: Alignment cover image

AI Safety via Debate

AI Safety Fundamentals: Alignment

CHAPTER

The Power of Debate Agents

We emphasize that using debate does not restrict the structure of the agents. In particular training is stable around the Nash equilibria. Unstable training might mean agents learn to be honest, forget how to defend against dishonesty and then get beaten by dishonest fluctuations. At Nash Equilibria, debate agents are approximately as strong as unrestricted AI, agents trained with no safety measures.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner