The JM Buzz cover image

The JM Buzz

JM Buzz Deep Dive: Moving Beyond Null Hypothesis Significance Testing (with Dr. Christopher Bechler)

Feb 29, 2024
This podcast features Blake McShane, Eric Bradlow, John Lynch, Robert Meyer, and Fred Feinberg—renowned scholars advocating for a shift from null hypothesis significance testing in research. They discuss the pitfalls of overrelying on p-values and emphasize the importance of nuanced statistical approaches. Topics include improving measurement quality, the importance of advanced statistical techniques, and how industry perceptions can shift with better data transparency. The conversation urges a reevaluation of practices to enhance research validity and impact.
37:43

Podcast summary created with Snipd AI

Quick takeaways

  • The binary approach to p-values has led to misinterpretations in research, necessitating a shift towards more nuanced statistical analysis practices.
  • Educating industry professionals on advanced statistical methods can enhance decision-making by promoting a deeper understanding of research outcomes beyond p-value thresholds.

Deep dives

The Limitations of P-Values

The reliance on p-values, particularly the common threshold of 0.05, has led to a problematic binary approach to statistical significance in research. This binary categorization often results in the misinterpretation of findings, where studies with p-values just above this threshold are dismissed as insignificant, while those below are celebrated, despite the variability inherent in statistical data. For instance, two similar studies might yield vastly different p-values due to random sampling variation, yet both can be considered compatible. This focus on p-values not only biases the publication landscape but also skews the understanding of research outcomes, reinforcing the need for a more nuanced interpretation of statistical evidence.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode