Red flags in education research with Ben Solomon (Ep 23)
Jan 26, 2024
auto_awesome
Math professor Anna Stokke interviews Dr. Ben Solomon, a psychology professor known for his expertise in research methodology. They discuss flaws in education research papers, the importance of evidence-based practices in education, and the need for critical evaluation of claims. The podcast explores red flags in education research, the controversy around teaching standard algorithms, and the significance of math education for career opportunities.
Teaching standard algorithms as the foundation in mathematics education reinforces place value and develops confidence and fluency in calculations.
When evaluating research papers in education, look out for red flags such as exaggerated claims, weak research design, and questionable citations.
Structured and focused practice, even for a few minutes a day, can significantly improve students' mathematical skills and should be prioritized.
Deep dives
The Importance of Teaching Standard Algorithms
Standard algorithms are important in mathematics education as they have been developed over centuries and are the most efficient means to solve arithmetic problems. Teaching students the standard algorithms first helps them develop confidence and fluency in calculations. While it's valuable to introduce additional strategies to demonstrate different perspectives, the standard algorithm should always be the foundation because it reinforces place value and has been shown to be effective.
Questioning the Study on the Harmfulness of Standard Algorithms
The study by Constance Kamii and Anne Dominick, titled "To Teach or Not to Teach Algorithms," is often cited as evidence for the claim that standard algorithms are harmful to understanding base 10 concepts. However, this study has major flaws. It is a correlational study without proper control of teaching methods, a small sample size, and an insufficiently described research design. Therefore, its conclusions should be viewed skeptically and should not be used to influence education policy.
Evaluating Research in Education
When presented with research papers to support educational claims, it is important to critically evaluate the methodology used. Red flags to look out for include exaggerated claims, absence of meaningful and measurable criteria, unusual experimental conditions, weak research designs, and questionable citations. By being aware of these red flags, teachers and parents can better assess the reliability of research and make informed decisions regarding educational practices.
Importance of Practice in Mathematics Education
Practice is a crucial element in developing mathematical fluency and proficiency. The podcast emphasizes that structured and focused practice, such as timed problem-solving under specific conditions, can significantly improve students' mathematical skills. It dispels the misconception that practice is unnecessary or time-consuming, highlighting that even a few minutes of targeted practice each day can make a substantial difference in students' mathematical abilities.
Understanding Rigorous Educational Studies
The podcast delves into the characteristics of a rigorous educational study, using an example of a randomized controlled trial (RCT) in kindergarten mathematics intervention. The host explains that RCTs are considered the gold standard in educational research as they eliminate threats to study validity by ensuring equivalent groups at the beginning. The podcast also discusses the importance of funding sources, realistic interventions, large sample sizes, detailed procedures, statistical analyses, measurement systems, fidelity of implementation, and limitations sections in contributing to the credibility and reliability of educational studies.
Join math professor, Anna Stokke, for a discussion with Dr. Ben Solomon in the final episode of the first season of Chalk & Talk. Ben is a psychology professor and a researcher in math assessment and intervention, known for his expertise in research methodology. One of the goals of this episode is to provide teachers, parents, and the wider public with tools for critically evaluating claims in education. The resource page for this episode describes five red flags to watch for in education research studies.
Anna asked Ben to analyze two specific education papers. The first paper has often been used to justify misguided claims about standard algorithms. They discuss flaws with the methodology in that paper. Ben also analyzes a high-quality education paper, highlighting the qualities that elevate it to the status of a rigorous education study, from which meaningful conclusions can be drawn. Along the way, they have a passionate discussion about the importance of teaching standard algorithms.
The conversation wraps up with a discussion on the science of learning and the need for education to evolve to use evidence-based practices and data-driven decision-making to achieve best outcomes for students. They hope this episode equips educators and parents with some tools to critically evaluate claims, ensuring that educational practices are grounded in sound research.
Thank you for joining Anna Stokke for the first season of Chalk & Talk! Follow Anna on X @rastokke to receive advance notifications for new episodes.
