AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How Can Reinforcement Learning Go Off the Rails?
Reinforcement learning is about how you develop a set of behaviors. Stuart russell, for example, who we've interviewed on this show, thinksthat we kind of need to do away with reinforcement learning for sufficiently advanced agents. So there's kind of a double optimization problem going on. You have some behaviour in mind, you need to create a reward which will in turn incentiviz that behavior.