Boundaryless Conversations Podcast cover image

#84 Gardening Platforms and the Future of Open Ecosystems with Alex Komoroske

Boundaryless Conversations Podcast

NOTE

Slowing Down Goodhart's Law: Use Multiple Metrics + Recognize the Cleverness of People

Goodhart's Law highlights the risk of optimizing for a single metric, as it may no longer measure the desired outcome. The different ways to accelerate Goodhart's Law include solely focusing on a single metric, which can lead to fraudulent behavior. Additionally, the cleverness of participants can expedite the law by finding loopholes and innovations that only affect the metric, not the actual outcome. It's crucial to use a portfolio of metrics and check metrics to mitigate this effect. However, using proxy metrics to steer based on long-term outcomes can lead to the proxy metric becoming the primary focus, overshadowing the long-term goal it was meant to represent.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner