Let’s Stop Relying on Biased Teaching Evaluations with Joanna Wolfe
Nov 30, 2023
auto_awesome
Joanna Wolfe, Teaching Professor at CMU, discusses biases in teaching evaluations affecting women and faculty of color. She offers strategies for universities to mitigate biases in student evaluations, emphasizing the need for systemic changes in higher ed teaching.
Student evaluations of teaching are biased against women and faculty of color, hindering innovation.
Customizable evaluation forms and specific questions can mitigate biases in teaching evaluations.
Deep dives
Challenges with Student Course Surveys
Student course surveys are a widely used method for evaluating teaching effectiveness. Dr. Johanna Woof highlights the biases present in these evaluations, showing how gender and racial biases impact instructors' ratings. Despite the documented biases, these evaluations lack correlation with actual learning outcomes, making them ineffective measures of teaching performance.
Improving Evaluation Practices
To address biases in student surveys, Dr. Johanna Woof suggests practical solutions. One key recommendation is to replace vague questions on evaluations that can amplify biases. By asking more specific questions related to learning outcomes and teaching effectiveness, institutions can gather more meaningful feedback. Educating students to be objective in their evaluations and focusing on constructive feedback rather than personal judgments can help mitigate biases.
Incentivizing Bias Mitigation
Universities could incentivize faculty members to study and develop better evaluation instruments to reduce biases. By harnessing in-house expertise and forming task forces to improve evaluation practices, institutions can create more customized and effective evaluation tools. Implementing solutions like customizable evaluation forms can lead to more valid and reliable assessment of teaching performance.
While there is extensive research on the use of student surveys in the evaluation of teaching, the recommended practices are often not utilized. How does this negatively impact innovation in teaching? How do these evaluations perpetuate bias against women and faculty of color? What can we do about it? Today we tackle these questions with Joanna Wolfe, Teaching Professor of English and Affiliated Faculty of Mechanical Engineering at Carnegie Mellon University, who wrote the January 2022 Inside Higher Ed article, “Let’s Stop Relying on Biased Teaching Evaluations.” Dr. Wolfe offers three helpful strategies that universities can implement to mitigate some of the potential harm that student evaluations can cause.
This is our final episode of Season 7 of Dead Ideas in Teaching and Learning! We will be back in January 2024 with Season 8, continuing to unpack systems and systemic changes that are needed to improve higher ed teaching and student learning! Happy Holidays to all of our listeners!