
#373 – Manolis Kellis: Evolution of Human Civilization and Superintelligent AI
Lex Fridman Podcast
Examining Goodhart’s Law and the Problem with Objective Metrics
Good Heart's Law states that every metric that becomes an objective ceases to be a good metric/nThe paper 'Death by Round Numbers and Sharp Thresholds' investigates discontinuities in biomarkers and finds that a biomarker that becomes an objective ceases to be a good biomarker/nA biomarker used as a treatment decision becomes inversely correlated with risk because it is used to induce treatment/nA single metric without the ability to revise will cease to be a good metric once it becomes a solid objective
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.