Bonus: Preventing an AI-Related Catastrophe
Hear This Idea
00:00
A Planned AI System That Doesn't Seek Power
In the most extreme scenarios, a planning AI system with sufficiently advanced capabilities could successfully disempower us completely. It might be hard to find ways to prevent this sort of misalignment. We may be able to design systems that simply don't have objectives to which the above argument applies and thus don't incentivize power-seeking behavior.
Transcript
Play full episode
