AI Safety Fundamentals: Alignment cover image

What Failure Looks Like

AI Safety Fundamentals: Alignment

CHAPTER

The Problems With AI Systems

As the world becomes more complex, there are more opportunities for influence seekers to find other channels to increase their own influence. If ML systems are more sophisticated than humans, immune systems must themselves be automated. And if ML plays a large role in that automation, then the immune system is subject to the same pressure towards influence seeking. This concern doesn't rest on a detailed story about modern ML training. The important feature is that we instantiate lots of patterns that capture sophisticated reasoning about the world - some of which may be influence seeking. Once such patterns exist, a messy, distributed world just creates more and more opportunities for Influence Seekers to expand their influence.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner