5min chapter

Data Skeptic cover image

Goodhart's Law in Reinforcement Learning

Data Skeptic

CHAPTER

The Cobra Effect - An Apocryphal Story

There's this thing called the cobra effect, which is related to goodheart's law. So i think there was an example with colonial vinam french governor deciding that they wanted to get rid of rats - so he paid a bounty on rats tails. And people started breeding rats, chopping their tails off, collecting the bounty in the tail and then releasing the tailless rat. So again, exactly the opposite from the policy maker. But when you are modelling in real life, there are always going to be hidden variables. You have to draw the line somewhere when youe con o modelling up a problem. If you had the choice, it'd be better to use non policy method

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode