2min snip

Boundaryless Conversations Podcast cover image

#84 Gardening Platforms and the Future of Open Ecosystems with Alex Komoroske

Boundaryless Conversations Podcast

NOTE

Slowing Down Goodhart's Law: Use Multiple Metrics + Recognize the Cleverness of People

Goodhart's Law highlights the risk of optimizing for a single metric, as it may no longer measure the desired outcome. The different ways to accelerate Goodhart's Law include solely focusing on a single metric, which can lead to fraudulent behavior. Additionally, the cleverness of participants can expedite the law by finding loopholes and innovations that only affect the metric, not the actual outcome. It's crucial to use a portfolio of metrics and check metrics to mitigate this effect. However, using proxy metrics to steer based on long-term outcomes can lead to the proxy metric becoming the primary focus, overshadowing the long-term goal it was meant to represent.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode