Space framework offers developer-centric metrics focused on sentiment and collaboration.
New paper introduces dimensions like flow state and feedback loops for enhancing developer experience.
Combining perception and workflow data provides a holistic view for measuring and improving developer productivity.
Deep dives
New Paper Introduces Developer Productivity Framework
The podcast episode discusses a new paper written by Avi Nura, Dr. Nicole Forsgren, Margarina and Suri, and Michaela Grayler. This paper, published in ACM, offers a fresh framework for measuring and enhancing developer productivity, expanding on previous research. Laura Tacko, a former engineering director at CloudBees, joins the conversation to explore common ineffective metrics used by organizations, the evolution of frameworks like Dora and Space, and detailed topics from the paper focusing on the concept of developer experience and how to enhance it.
Unveiling the Space Framework for Developer Productivity
The discussion delves into the Space framework developed by Nicole Forsgren and her co-authors, emphasizing a meta-analysis of decades of research on developer productivity to provide a holistic approach. Unlike an easy button for metrics, Space offers categories rather than direct metrics, aiming to convey a developer-centric understanding for improving productivity. Although challenging to implement due to its nuanced approach, Space focuses on dimensions like sentiment, satisfaction, communication, and collaboration to provide a comprehensive view of developer productivity.
Evolving Towards Developer Experience Framework
The conversation transitions to a new paper introducing three core dimensions of developer experience: flow state, feedback loops, and cognitive load. These dimensions, derived from extensive research, aim to simplify and operationalize the understanding of developer experience for organizations. By providing example metrics and recommendations, the paper offers practical insights for organizations seeking to enhance the quality of life for their development teams and improve overall productivity.
Dimensions of Developer Experience: Flow State and Motivation
Flow state, a cognitive state of being fully energized and immersed in work, is crucial for software developers' productivity. Encouraging developers to reach a flow state involves providing fulfilling and energizing work that motivates them. Leaders should focus on creating an environment where developers are so engaged in their tasks that they lose track of time, leading to optimal productivity.
Comprehensive Measurement of Developer Experience: Surveys and System Data
Measuring developer experience involves two key dimensions: perception data and workflow data. While system data provides precise insights, surveys play a vital role in capturing developers' perceptions and sentiment. Surveys, although often underestimated, offer valuable insights and complement system data, allowing organizations to make informed decisions and improve developer experience effectively.
In this episode, Abi is interviewed by Laura Tacho about the new paper he co-authored with Dr. Nicole Forsgren, Dr. Margaret-Anne Storey, and Dr. Michaela Greiler. Abi and Laura discuss the pitfalls of some of the common metrics organizations use, and how the new paper builds on prior frameworks such as DORA and SPACE to offer a new approach to measuring and improving developer productivity.
Discussion topics:
(2:20) Laura’s background
(3:59) Laura’s view on git metrics
(11:05) What developer experience (DevEx) is
(14:37) How the authors came together for this paper
(18:55) How DORA and SPACE are different
(22:38) Limitations of DORA metrics
(24:43) Employing the DORA metrics at GitHub
(27:47) What the SPACE framework is
(30:44) Whether to use DORA or SPACE or both
(33:54) Limitations of the SPACE framework
(37:29) The need for a new approach
(38:46) What the new DevEx paper solves
(40:13) The three dimensions of developer experience
(40:54) Flow state
(43:10) Feedback loops
(43:52) Cognitive load
(44:51) Why developer sentiment matters
(47:58) Using both perceptual and workflow measures
(50:59) Examples of perceptual and workflow measures
(54:05) How to collect metrics
(59:47) How other companies are measuring and improving developer experience
(01:02:56) Advice for earlier-stage or growing organizations
Resources for learning more about the DevEx framework: