AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Examining Goodhart’s Law and the Problem with Objective Metrics
Good Heart's Law states that every metric that becomes an objective ceases to be a good metric/nThe paper 'Death by Round Numbers and Sharp Thresholds' investigates discontinuities in biomarkers and finds that a biomarker that becomes an objective ceases to be a good biomarker/nA biomarker used as a treatment decision becomes inversely correlated with risk because it is used to induce treatment/nA single metric without the ability to revise will cease to be a good metric once it becomes a solid objective