AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is There a Research Degree of Freedom?
Research degrees of freedom include choosing among dependent variables, choosing sample size and reporting sub sets of experimental conditions. In each one you can increase the chance by between ten and 20 %, depending on the threshold. But for the normal p under not point five, each of these dual things, like controlling for gender or interaction with gender, could increase the likelihood to get a significant result by 12%. And if you combine them, if you do multiple versions, once you're adjusting, you get up to 60 or 80% odds of getting a false positive result. The more transparent you are doesn't prevent you from creating results and producing them, but just means that people can put them in more