AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
2min chapter
David Krueger–Coordination, Alignment, Academia
The Inside View
The Problem With Reward Functions
There's been a lot of discussion and like a decent amount of empirical work on this, but we were trying to approach it theoretically. I feel like it's pretty close to one of the papers that were published before where they have this like performance metric and then there's like the reward metric. And so you can say like, you know, this reward function only really expresses my preferences about like this narrow set of behaviorsI don't really care about behaviors outside of that. But if we want to keep using reward functions we need to just think about them as sort of like a hack that we need to find some other way of dealing with or maybe strengthen the definition somehow or tweak it
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode