With the current sample sizes that are circulating in most scientific fields, this is not going to be easy. We need to think more broadly about replacing our statistical inference tools with more fit for purpose tools and also moving to the design phase of research. I'm very much in favor of preregistration and I have supported that for many years over a decade in various fields. Is it perfect? No. But at least it's a step in the right direction.
John Ioannidis of Stanford University talks with EconTalk host Russ Roberts about his research on the reliability of published research findings. They discuss Ioannidis's recent study on bias in economics research, meta-analysis, the challenge of small sample analysis, and the reliability of statistical significance as a measure of success in empirical research.