Association isn't Causation | Ken O'Connor | Teaching to the Test
May 31, 2021
auto_awesome
Ken O'Connor, an education expert originally from Melbourne and now based in Toronto, shares his unique journey and insights on assessment and grading. He reflects on the transition from teaching to specializing in assessment, emphasizing the need for reform in grading practices. The conversation touches on the pitfalls of teaching to the test and explores how traditional methods can change student behavior. Ken also candidly discusses his vibrant career umpiring field hockey, shedding light on the impact of instant replay technology on sports.
The podcast emphasizes the need for critical thinking in education, particularly regarding misinformation and the misuse of data in assessments.
Ken O'Connor highlights the significant impact of flexible grading practices during the pandemic, promoting student agency and self-regulation in learning.
A key theme is the distinction between correlation and causation, warning against oversimplified conclusions drawn from misleading data relationships.
Deep dives
Honoring Indigenous Children
The podcast begins by honoring the 215 Indigenous children whose remains were discovered at a former residential school in Kamloops, British Columbia. This tragic revelation highlights the deep historical trauma and loss among Indigenous communities due to the residential school system in Canada. The discussion emphasizes the importance of acknowledging this dark chapter in history while recognizing the progress made toward reconciliation. Ultimately, it calls for collective efforts to change the future for Indigenous peoples, asserting that while the past cannot be altered, a moment of silence is offered to honor those affected.
The Importance of Assessment Literacy
The episode transitions into a discussion about assessment and grading practices, featuring a guest who has become a notable figure in this field. The conversation reflects on the previous connections made between the host and the guest and emphasizes how assessment literacy remains crucial for educators. It highlights that well-designed assessments can positively influence student learning and engagement. The podcast suggests that clear communication about learning expectations is essential in fostering a positive assessment culture.
Understanding 'Bullshit' in Data
A significant portion of the episode revolves around the book 'Calling Bullshit: The Art of Skepticism in a Data-Driven World', which explores the proliferation of misinformation and data manipulation in today's society. The discussion includes insights on how easily 'bullshit' can be created, which is much harder to refute, highlighting the necessity for critical thinking skills. Various examples are provided to illustrate how data can tell misleading stories, emphasizing that flawed data leads to flawed conclusions. The importance of skepticism regarding the data presented and the cultivation of critical thinking in education is underscored.
Causality vs. Association
The podcast further addresses the common misconception that correlation equates to causation, illustrating the pitfalls of making erroneous connections based on superficial data relationships. The discussion includes an example of a misleading graph showing a correlation between organic food sales and autism rates, which falsely implies causation. The speaker argues that understanding the difference between association and causation is imperative in both educational practices and broader societal discussions. This understanding is critical to avoid oversimplified narratives surrounding feedback and grading in education.
Adapting Grading Practices Post-Pandemic
As the conversation shifts to insights gained during the pandemic, the importance of flexibility in grading practices is emphasized, noting that many educators found success in adapting their methods. Experiences shared highlight that leniency in deadlines resulted in improved student performance, questioning traditional grading rigidities. Various schools have implemented pass/fail systems, leading to positive outcomes, a trend that some educators wish to see continue. The focus remains on student agency and self-regulation, indicating a movement toward a more learner-centered approach to assessments compared to pre-pandemic practices.
In Don't @ Me (3:34), Tom discusses a few highlights from the book, "Calling Bullshit" and how they remind him of some important principles in education. Then, Tom is joined by Ken O'Connor (16:00) to discuss his journey from Melbourne to Toronto, to talk assessment & grading (of course), and to learn about his illustrious Field Hockey umpiring career!. Finally, in Assessment Corner (1:11:21), Tom focuses on the idea of teaching to the test and what we can do to try to mitigate the fact that sometimes people’s behavior changes when they know they are being tested.