AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Human Alignment Problem
I think the human alignment problem is a terrible phrase because it is very, very different to try to build systems out of humans. And I think that all the analogies between them are horribly misleading. The first AI is you're trying to build, not a million years later, the first ones look more like narrowly specialized biologists than getting the full complexity and wonder of human experience in there. It wants to preserve itself even as it becomes much smarter,. A drastic system change is going to have all kinds of side effects which we won't be able to see coming in advance.