Boundaryless Conversations Podcast cover image

#84 Gardening Platforms and the Future of Open Ecosystems with Alex Komoroske

Boundaryless Conversations Podcast

00:00

Slowing Down Goodhart's Law: Use Multiple Metrics + Recognize the Cleverness of People

Goodhart's Law highlights the risk of optimizing for a single metric, as it may no longer measure the desired outcome. The different ways to accelerate Goodhart's Law include solely focusing on a single metric, which can lead to fraudulent behavior. Additionally, the cleverness of participants can expedite the law by finding loopholes and innovations that only affect the metric, not the actual outcome. It's crucial to use a portfolio of metrics and check metrics to mitigate this effect. However, using proxy metrics to steer based on long-term outcomes can lead to the proxy metric becoming the primary focus, overshadowing the long-term goal it was meant to represent.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app