Paul Matthews: Good learning outcomes are defined by good measurement
Jul 13, 2023
auto_awesome
Paul Matthews, an expert in workplace learning and learning transfer, discusses the importance of defining and measuring learning outcomes. He emphasizes the need for clarity, observable terms, and understanding the cost of inaction. The chapter also highlights the importance of measuring the impact of learning and training programs, identifying appropriate measures such as observable behaviors and personal stakeholder measures. The discussion further explores the purpose of L&D and the significance of defining outcomes, bridging the gap between current and desired states, and involving managers in evaluating the impact and ROI of L&D interventions.
Defining clear and measurable learning outcomes is crucial before measuring the success of a training program.
Understanding the potential negative impacts or costs of not implementing a learning program helps prioritize its importance.
Deep dives
Defining Clear Learning Outcomes
Before measuring the outcomes of a training program, it is essential to have clarity on what those outcomes are. Stakeholders should come to a common agreement on the observable behaviors or results that indicate successful achievement of the outcomes. This involves asking stakeholders to envision 100% success and describe what they would observe or experience. It is important to define the outcomes in measurable terms that can be observed or quantified, ensuring that there is no ambiguity or differing perspectives.
Considering the Cost of Inaction and ROI
Before starting to measure the outcomes, it is crucial to understand the cost of inaction or doing nothing. By identifying the potential negative impacts or costs to the organization if the learning program is not implemented, it provides insight into the priority and importance of the program. L&D professionals should focus on understanding the stakeholder's expectations, which are often driven by their own internal yardsticks. While return on investment (ROI) is a common measure, the measurement should align with the outcomes agreed upon by stakeholders and not merely serve as a justification for the L&D budget.
Choosing Appropriate Measures Based on Agreed Outcomes
The measures used to evaluate a learning program depend on the defined outcomes. These measures should help determine whether the desired outcomes have been achieved. Possible measures include assessing memorization of information, observing observable behaviors, monitoring related key performance indicators (KPIs), and considering personal measures unique to individual stakeholders. It is essential to establish outcomes that can be observed or quantified and align the measurement methods accordingly. Additionally, the responsibility for measuring the impact of the program should be shared between L&D and the managers who requested the intervention, emphasizing the manager's role in justifying the business case for the program.
From capability at the point of work to learning transfer, Paul Matthews is always looking to make workplace learning as effective as possible. Here he shares his latest thinking with UNLEASH.