Increments cover image

#49 - AGI: Could The End Be Nigh? (With Rosie Campbell)

Increments

CHAPTER

The Importance of Reinforcement Learning in Reward Hacking

I'm still trying to drill down on how much I disagree with you. How much your examples are meant to display the end of the world versus just like a severe problem? RL algorithms have shown in the past that they can engage in reward hacking. There's that famous video game, but I don't know which one it was,. It spun around in a circle in some way to maximize points. That is a very different problem than doing the same thing and then waking up to this system having taken over the world.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner