AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Problem With Alignment
I think often people are thinking about kind of alignment in the wrong way. There will be powerful models, they will be agentic. We're getting towards them. If such a model wanted to wreak havoc and destroy humanity or whatever, I think we have basically no ability to stop it. It might be just as bad or just as unpredictable. So that definitely seems the case. The best example we've seen of that is like being in Sydney, right? Where it's like, I don't know how they train that model. Like actually one and two for me are pretty motivated. I'm like, okay, this thing's gonna be powerful. It could destroy us."