
CHAOSScast
This CHAOSS Community podcast features members who spent considerable time and effort to understand open source community health and how we can measure it through metrics, analytics, and software. We invite guests to this podcast to talk about how they use open source community health metrics and software in their own open source communities, companies, or foundations. This podcast fills the gap with open source community metric definitions and software on one side and their use on the other side.
Latest episodes

Jan 30, 2024 • 40min
Episode 78: University Open Source Engagement
Join the panelists from various universities as they discuss the relationship between open source software and university missions, the role of libraries in supporting OSS, and the collaborative culture fostering community and innovation. They explore the challenges and promises of developing universities OSPOs and highlight the potential of OSS in enhancing educational experiences and research output.

Jan 16, 2024 • 23min
Episode 77: Open Source Metrics at Microsoft
In this episode, Dawn Foster hosts a discussion with three guests from Microsoft's Open Source Programs Office: Emma Irwin, James Siri, and Justin Gosses. They talk about how Microsoft measures the health of open source communities, their experiences with the CHAOSS Community, and the critical role of open source within the organization. Topics include metrics, tackling security issues, the value of open source contributions, and tracking and improving processes at Microsoft.

Jan 1, 2024 • 43min
Episode 76: CHAOSS Goals for 2024 and Beyond
The CHAOSS Project's goals for 2024 and beyond include establishing metrics as international standards, growing the user and contributor communities, rethinking metrics in open source projects, and reflecting on vanity metrics. The speakers also discuss the importance of community engagement and share personal experiences with books and fascinating discoveries.

Dec 19, 2023 • 33min
Episode 75: DEI Metrics Overcoming Social Barriers in OSS
Anita Ihuman, a developer advocate and technical writer, discusses the usage and effectiveness of DEI metrics in open source communities, including surprising findings such as lack of codes of conduct and DEI as a myth in some projects. They highlight projects using DEI metrics like Apache Traffic Control and emphasize the importance of implementing DEI metrics to enhance inclusivity. The speakers also share personal anecdotes at the end of the podcast.

Nov 21, 2023 • 42min
Episode 74: Building on Top of CHAOSS Software
Panelists Sean Goggins, Yehui Wang, Mike Nolan, and Cali Dolfi discuss the CHAOSS software, Augur, and GrimoireLab. They delve into projects like Augur, OSS Compass, and Project Aspen's 8Knot. The discussion explores the role of CHAOSS software in open source and community health, data visualization, and the transformative potential of Mystic's prototype software for academic contributions. Exciting future projects and the value of diverse perspectives are also highlighted.

Nov 2, 2023 • 41min
Episode 73: Reflections on the LF OSS Maintainer Report
The podcast discusses the Linux Foundation Research OSS Maintainers Report, exploring topics such as obtaining a representative sample in open source research, the bias toward technical contributors, and the importance of considering long-term engagement of contributors. They also touch upon best practices, including documentation and diversity, and how these practices can be connected across different categories.

Oct 19, 2023 • 33min
Episode 72: Open Source Software Viability and Project Selection
Thank you to the folks at Sustain for providing the hosting account for CHAOSSCast!
CHAOSScast – Episode 72
In this episode, our host, Matt Germonprez, is joined by Dawn Foster from the CHAOSS Community, Sophia Vargas from Google, and Gary White from Verizon. Today, they dive into the crucial topic of assessing the viability of open source projects for adoption within organizations. The discussion covers the intricacies of evaluating project viability, the challenges of project failure, and the necessity of continuous assessments. The panelists provide valuable insights on mitigating risks, leveraging metrics, and the importance of active engagement within open source communities. This episode offers a wealth of knowledge and practical advice for navigating the world of open source software. Download this episode now to hear more!
[00:02:13] The discussion begins on the importance of assessing the viability of open source projects for adoption within organizations. Gary emphasizes the need to formalize the assessment of open source project viability beyond just technical metrics, Sophia stresses the importance of rigor in evaluating open source tools due to the lower barrier to adoption, and Dawn points out the importance of context, where the viability assessment depends on how the project is used within the organization.
[00:06:32] The conversation shifts to when an open source project fails or changes significantly within an organization. Dawn discusses the challenges and uncertainty companies face when an open source project becomes unusable due to license changes or discontinuation, Sophia highlights the complexities and burdens of change management when a project fails, and Gary mentions the negative impact on morale and the time-consuming nature of dealing with project failures.
[00:10:55] Sophia discusses the challenges in communication between project leaders and end users, particularly when projects are consumed through third-party package managers. Gary highlights the challenge of getting project leaders and developers motivated to assess project viability and the need for data-driven metrics to facilitate communication between leadership and implementation teams.
[00:13:09] Dawn stresses the importance of continuous assessments of open source project viability rather than treating it as a one-time task.
[00:14:06] How do we assess if a project is good? Dawn discusses her historical approach to assessing open source projects, which included manual assessments.
[00:16:31] Gary emphasizes the common practice of engineers making quick project choices without thorough assessments due to the ease of finding solutions online.
[00:19:41] Sophia highlights the importance of considering how a project is used within the organization and the strategic implications of choosing open source projects, especially in large organizations.
[00:21:50] Matt asks about monitoring and mitigating risks when using open source projects that may not be ideal from a viability perspective but are popular. Dawn acknowledges that project viability is not binary and can vary in terms of risk, suggesting that contributing to open source projects can mitigate risks.
[00:22:56] Gary emphasizes the importance of becoming engaged and active members of open source communities to gain insight into project changes and mitigate potential risks.
[00 24:15] Sophia highlights the role of metrics and monitoring in risk mitigation, mentioning that tracking certain information may not be easy but it is crucial. Dawn notes the lack of ongoing viability monitoring and suggests the need for more sophisticated approaches.
[00:26:37] Gary agrees that monitoring is essential and mentions a metric called “lib year” to track the age of dependencies as an example of monitoring for open source projects, and he discusses the importance of automated recommendations within software scanning tools to help users make informed decisions about dependencies.
[00:28:27] Sophia addresses the challenge of scale when dealing with many open source projects, emphasizing the need to adapt monitoring and risk mitigation approaches based on the organization’s portfolio size.
Value Adds (Picks) of the week:
[00:30:15] Matt’s pick is running in the dark on cool mornings.
[00:30:33] Dawn’s pick is hanging out with people when she was at the Open Source Summit in Bilbao, Spain.
[00:31:03] Sophia’s pick is joining an orchestra a few months ago.
[00:31:41] Gary’s pick is having pumpkin spice back in his life.
*Panelists: *
Matt Germonprez
Dawn Foster
Sophia Vargas
Gary White
Links:
CHAOSS
CHAOSS Project Twitter
CHAOSScast Podcast
podcast@chaoss.community
Ford Foundation
Georg Link Twitter
Matt Germonprez Twitter
Dawn Foster Twitter
Sophia Vargas Twitter
Gary White LinkedIn
libyear
OSS Project Viability Metrics Models:
OSS Project Viability: Community
OSS Project Viability: Compliance + Security
OSS Project Viability: Governance
OSS Project Viability: Strategy
Special Guest: Gary White.Support CHAOSScast

Oct 5, 2023 • 47min
Episode 71: What's New in CHAOSS: Podcast Reboot Episode
The CHAOSScast team discusses the relaunch of the podcast and focuses on the development of metrics and metric models in the Chaos Project. They highlight the importance of understanding context, consolidating metrics, and categorizing them for accessibility. The podcast also covers the evolution of Auger and updates in Grimoir Lab, data management and enrichment in CHAOSS, community growth and initiatives, and moments of joy.

Jan 27, 2023 • 42min
Episode 70: Revisiting Metrics Journeys with Chris Mercer
Hello and welcome to CHAOSScast Community podcast, where we share use cases and experiences with measuring open source community health. Elevating conversations about metrics, analytics, and software from the Community Health Analytics Open Source Software, or short CHAOSS Project, to wherever you like to listen. Venia and Lori are hosting a special revisit episode with special guest, Chris Mercer, Co-Founder of Measurement Marketing.io. Today, we’ll find out what Measurement Marketing does, where we were with measurement when Chris was on last, and how things have changed throughout the years. He goes in depth about the new Measurement Marketing Framework, the ACE model, and he shares his thoughts on Google Analytics 4 and why he thinks now is the time to get into it. Download this episode now to find out much more, and don’t forget to subscribe for free to this podcast on your favorite podcast app and share this podcast with your friends and colleagues!
[00:02:22] Chris tells us his background and what Measurement Marketing does.
[00:03:47] When Chris was on this podcast previously there was this notion of measuring frameworks and measuring a system, Chris details where we were originally with measurement and how things have changed.
[00:05:17] We hear about the new Measurement Marketing Framework and the three simple steps: Plan it out, build it out, and launch it.
[00:09:39] Chris lets us know what has stayed the same in his business.
[00:10:57] We find out how Chris applies the measurements to open source as a customer journey, and he explains the ACE model that they teach.
[00:14:36] Venia wonders if Chris is finding that Google Analytics 4 moving more in line with that synchronicity of measuring behaviors as they happen and as people use the system, and where does he see Google Analytics fitting into this new way of measure.
[00:19:52] Chris shares his thoughts on whether he thinks that Google Analytics 4 is going to move more into a community operations role in any way.
[00:21:22] Lori asks Chris for tips on some struggles she has as a Community Manager with how to relate data to someone in a CEO or OPS position in their language versus speaking community speak.
[00:32:03] Find out how measurement is changing as Chris explains.
[00:36:03] Venia wonders how Chris imagines community and this new notion of a measurement department meshing and working together.
Value Adds (Picks) of the week:
[00:38:40] Chris’s pick is to start by learning strategy first.
[00:40:35] Venia’s pick is taking a step back from the day-to-day things and adding to her calendar about four hours, twice a week, to do whatever she wants.
**Panelists:
Venia Logan
Lori Goldman
Guest:
Chris Mercer
Sponsor:
SustainOSS
Links:
CHAOSS
CHAOSS Project Twitter
CHAOSScast Podcast
podcast@chaoss.community
Ford Foundation
Georg Link Twitter
Venia Logan Twitter
Lori Goldman LinkedIn
Chris Mercer Twitter
Measurement Marketing
CHAOSScast Podcast-Episode 14: The Theory and Future of Measurement with Chris Mercer
Measure Summit
Special Guests: Chris Mercer and Lori Goldman.Support CHAOSScast

Nov 11, 2022 • 41min
Episode 69: Community Insights with Hedan Zeng [Part 2 of 2]
Hello and welcome to CHAOSScast Community podcast, where we share use cases and experiences with measuring open source community health. Elevating conversations about metrics, analytics, and software from the Community Health Analytics Open Source Software, or short CHAOSS Project, to wherever you like to listen. Welcome back to Part Two to a conversation we had with our amazing guest, Hedan Zeng, who’s the Director of Product Management at Common Room. In Part One, we spoke to Hedan about the development of Common Room, the history of Hedan’s personal journey in community, and what Common Room’s real philosophies around community health have been. Today, we brought her back so we can talk more about our metrics. Download this episode now to find out much more, and don’t forget to subscribe for free to this podcast on your favorite podcast app and share this podcast with your friends and colleagues!
[00:03:22] Hedan does a quick recap of what Common Room the platform does.
[00:04:19] In the last episode, Hedan mentioned area they look at the health of the community, and one of them was around engagement and metrics around engagement, and she tells us things she has found valuable for her customers to look at.
[00:10:24] Venia brings up grapevine or unstructured community spaces, and she wonders how Hedan tackles these different sentiment developments in the actual metrics path and data flow for her system.
[00:12:48] Sophia wants to know if there are different ways that Hedan addresses the same kind of questions in terms of guiding her customers and understanding the nuances between platform sources and sentiments.
[00:14:52] We find out how Common Room addresses the nuance between these personas that while they might have some overlap, tend to have different orientations.
[00:16:47] Does Hedan think that there’s some explicit differences between how Common Room would tackle to completely different community avatars?
[00:19:07] Hedan tells us about some specific metrics to understand the different pieces that she’s been seeing.
[00:21:41] Venia brings up community interaction and Hedan talks more about how she’s generating that 3X engagement factor.
[00:23:38] Sophia wonders if Common Room can identify whether or not folks are at risk of burnouts, and Hedan tells us about how Common Room does a surface sentiment at a member level.
[00:28:38] We find out how Hedan’s user experience makes decisions about the metrics and the way she visualizes this data in her platform.
[00:32:22] We learn the process Common Room makes the users who are interacting and visualizing the data they go through.
[00:35:10] Looking at the membership statistics around various different platforms, Sophia wonders if this could be an effective way to gauge an open source project’s usage and then knowing that, we find out if it’s enough or if anything is missing to make a better assessment of the overall user community size.
[00:36:47] Find out where you can follow Hedan and Common Room online.
Value Adds (Picks) of the week:
[00:38:00] Hedan’s pick is being excited for football season and fantasy football season to commence.
[00:38:34] Sophia’s pick is to remember to breathe, take breaks, and do puzzles.
[00:39:44] Venia’s pick is Richard Millington and a webinar he did called, The Gold Standard of Community Data.
Panelists:
Venia Logan
Georg Link
Sophia Vargas
Guest:
Hedan Zeng
Sponsor:
SustainOSS
Links:
CHAOSS
CHAOSS Project Twitter
CHAOSScast Podcast
podcast@chaoss.community
Ford Foundation
Georg Link Twitter
Venia Logan Twitter
Sophia Vargas Twitter
Hedan Zeng Twitter
Hedan Zeng LinkedIn
Common Room
Common Room Community
Richard Millington Twitter
The Gold Standard of Community Data with Richard Millington (vimeo)
Special Guest: Hedan Zeng.Support CHAOSScast
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.