S3E16: Dennis Sherwood on The Great Grading Scandal: 1 in 4 grades is WRONG!
Aug 18, 2023
auto_awesome
Dennis Sherwood, a management consultant specializing in creativity, innovation, and systems thinking, discusses his book 'Missing the Mark', focusing on the issue of inaccurate school exam grades. Topics include implementing a transformative program for positive change in schools, strategies to address unreliable grading, challenges in education reform, the problem of groupthink, and transitioning power in the education system.
Approximately one-quarter of exam grades in England will be incorrect, highlighting the inherent problem of grading in the current system.
The issue of unreliable grades has been known for years, but there has been little action to address the problem.
Potential solutions to improve grade reliability include having fewer, broader grades, indicating the range of marks or fuzziness on certificates, using AI algorithms for marking, and shifting towards assessing oracy.
Addressing the power imbalance and resistance to change in education requires collaboration between political parties, education experts, and stakeholders for inclusive decision-making processes.
Deep dives
The problem of unreliable exam grades
About 1.2 million candidates in England have recently taken their exams and are awaiting their results. However, approximately one-quarter of the 6 million grades to be awarded will be incorrect due to the inherent fuzziness and subjective nature of grading. This means that around 1.5 million wrong grades will be given, which is larger than the total number of candidates. This highlights a significant problem in the current grading system, where students are likely to receive at least one incorrect grade without the right of appeal.
Denial and lack of action
The issue of unreliable grades has been known and published since 2016, but there has been a lack of action to address the problem. Offqual, the regulator of exams, has been in denial, refusing to acknowledge or fix the issue. This is evident in statements made by the former and current chief regulators, where conflicting statements about grade reliability have been given. The select committees in Parliament have attempted to address the issue, but key questions remain unanswered.
Potential solutions
There are several potential solutions to improve the reliability of exam grades. One option is to have fewer, broader grades that include a range of marks within each grade. This would help absorb the inherent fuzziness and minimize discrepancies caused by grade boundaries. Another suggestion is to include an indication of the range of marks or fuzziness on the certificate itself, allowing students and institutions to understand the potential margin of error. The use of artificial intelligence (AI) is also being discussed as a potential solution, with AI algorithms providing consistent and unbiased marking. However, trust in the algorithm's wisdom and fairness would need to be established. Finally, a shift towards oracy, emphasizing spoken communication skills, could provide a more authentic and natural way of assessing students, although challenges in measuring and assessing oracy would need to be addressed.
The importance of addressing the issue
The unreliable nature of exam grades has significant implications for students, including university admissions and future opportunities. It perpetuates inequality, as students from wealthier families are more likely to access the review of marking process. Addressing this issue is crucial to ensure fairness, trust, and reliability in the grading system, ultimately benefiting all students.
The Importance of Reforming Education
One of the positive aspects of education reform is the increasing pressure for change from various groups. The Times Education Commission, rethinking assessment community, and other organizations are advocating for reform and recognizing the need to improve the curriculum, assessment methods, and prepare students for the 21st century. However, the biggest challenge lies in the current power structure, where those in power are resistant to change and maintaining the status quo. To shift this power imbalance, a change in government may be necessary, and a new administration that listens to the reform proponents could lead to progress in education.
The Obstacles of Power and Resistance to Reform
The main obstacle to educational reform is the current power imbalance, with those in authority resisting change and maintaining the existing system. Despite the efforts and influence of reform-minded groups, these voices are often not being heard or heeded. The power currently lies in the hands of individuals who do not want change, making it difficult to implement reforms that could improve education. Overcoming this challenge requires a change in government and a shift in power dynamics that allows for more inclusive decision-making and genuine collaboration between stakeholders.
Strategies for Change and Collaboration
To address the power imbalance and promote meaningful education reform, it is crucial to bring together different political parties, education experts, and stakeholders in collaborative decision-making processes. By creating cross-party committees or select groups that include various perspectives and allow for input from educators, students, parents, and other relevant parties, a more comprehensive and informed approach to education reform can be achieved. This would involve moving away from top-down decision-making and embracing an inclusive, vertical slice approach to governance, where decision-making power is shared amongst a diverse group of individuals with different backgrounds and expertise. Creating such spaces for dialogue, collaboration, and gradual change can help navigate the complex challenges and move towards a more effective and equitable educational system.
Dennis Sherwood is a management consultant who specialises in creativity, innovation, and systems thinking. He has a Physics Masters from the University of Cambridge, an MPhil in Molecular Biophysics and Biochemistry from Yale University and a PhD in biology from the University of California in San Diego. After being a consulting partner at Deloitte Haskins + Sells, and Coopers & Lybrand, he became an executive director at Goldman Sachs. He now runs his own business, The Silver Bullet Machine Manufacturing Company Limited, specializing in organizational creativity and innovation. He has been using systems thinking since 1984 and is one of the UK’s leading experts. In addition, he has authored 14 books on a variety of subjects, including systems thinking, creativity, innovation, and financial modelling. His most recent book is Missing the Mark: Why so many school exam grades are wrong - and how to get results we can trust - and this is the topic of this episode.
LINKS
Dennis's website: https://www.silverbulletmachine.com/
Rethinking Education conference - Sat 23rd September, London: https://bit.ly/reconf23
Making Change Stick: https://makingchangestick.co
The Rethinking Education podcast is hosted and produced by Dr James Mannion. You can contact him at www.rethinking-ed.org/contact, or via a social platform of your choosing:
Twitter: https://www.twitter.com/RethinkingJames
Insta: https://www.instagram.com/drjamesmannion
LinkedIn: https://www.linkedin.com/in/james-mannion/
SUPPORT THE RETHINKING ED PODCAST:
Become a patron: https://www.patreon.com/repod
Buy me a coffee: https://www.buymeacoffee.com/repod
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
