Flaws and Limitations in an Education Research Study

28min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

The speakers analyze the limitations and issues in an education research study, questioning its use in shaping education policy. They discuss concerns about the study's short length, lack of important details, and correlational design. They highlight the need for rigorous measures and standardized methods in research studies.

Join math professor, Anna Stokke, for a discussion with Dr. Ben Solomon in the final episode of the first season of Chalk & Talk. Ben is a psychology professor and a researcher in math assessment and intervention, known for his expertise in research methodology. One of the goals of this episode is to provide teachers, parents, and the wider public with tools for critically evaluating claims in education. The resource page for this episode describes five red flags to watch for in education research studies.

Anna asked Ben to analyze two specific education papers. The first paper has often been used to justify misguided claims about standard algorithms. They discuss flaws with the methodology in that paper. Ben also analyzes a high-quality education paper, highlighting the qualities that elevate it to the status of a rigorous education study, from which meaningful conclusions can be drawn. Along the way, they have a passionate discussion about the importance of teaching standard algorithms.

The conversation wraps up with a discussion on the science of learning and the need for education to evolve to use evidence-based practices and data-driven decision-making to achieve best outcomes for students. They hope this episode equips educators and parents with some tools to critically evaluate claims, ensuring that educational practices are grounded in sound research.

Thank you for joining Anna Stokke for the first season of Chalk & Talk! Follow Anna on X @rastokke to receive advance notifications for new episodes.

researchED Toronto, Canada: https://www.eventbrite.ca/e/researched-canada-the-science-of-learning-toronto-may-3-4-2024-tickets-765640259627

EPISODE TRANSCRIPT

https://www.annastokke.com/ep-23-transcript

EPISODE RESOURCES

https://www.annastokke.com/ep-23-resources

MUSIC

Intro and Outro: Coma Media – Catch it

Blue Dot Sessions – Arroz con leche, Cherie’s Polvo, Haventhorn, Mazamorra, Tarte Tatin, Noe Noe, Cornicob

Website: www.annastokke.com

X: @rastokke

Threads: @rastokke37