AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Dangers of Unaligned Competence
To be dangerous, I don't think you need necessarily to be running a self-preservation program. It's possible to have a reward function that is deeply counterintuitive to us. And yet it never occurs to this super genius, infinitely powerful machine that is having such, you know, potentially catastrophic impacts and not withstanding all of that capability and power. Yet we're doing nothing more than helping our kids spawn machines that could destroy us. There's just the space of AI fear in the space of conversations about what might happen next.