When a measure becomes a target, it ceases to be a good measure

The use of prestigious scientists as a substitute for actual replication is an example of Goodhart's Law. Goodhart's Law states that when a measure becomes a target, it ceases to be a good measure. This is because once people know that a measure is being used, they will start to game it. This cycle of gaming the measure occurs when the knowledge of the rules allows people to manipulate the measure. However, there are rare cases, like in Satoshi's Proof of Work, where the gaming of the measure is difficult. In these cases, the measure remains effective because people cannot exploit the game's rules.

Transcript

Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.