The Importance of Open Source Platform Engineering

Spotify is now excitedly part of the CNCF after moving away from the sandbabs. There was a fair amount of discussion back and forth around whether we should or whether we shouldn't. When you start to grow to a certain scale, the number of services become more than what you can fit in your head. So that was the initial kind of, maybe we've got something here that other people are struggling with.

Transcript

chevron_right

Play full episode

chevron_right

Transcript

Episode notes

With over 1,000 companies using it and 21.5K+ stars on GitHub, the Backstage open source project is quickly becoming a go-to tool for managing developer infrastructure. In this episode, I’ll sit down with Lee Mills, a Senior Engineering Manager from Spotify's Backstage project, to learn more about how the open source platform is revolutionizing the developer experience and how it aligns with the growing Internal Developer Platform (IDP) space. We’ll discuss the need that drove Spotify to build this internal tool, about the decision and journey to open source it and donate it to the CNCF (Cloud Native Computing Foundation). We’ll also discuss the new commercial plugins, what’s coming up on the roadmap, and much more.

Lee has worked as an engineering manager for the past 12 years, from Amazon to Spotify and everything in between. Prior to that Lee had a mixed background working in academia as a lecturer, worked as a Boom Op for television in the UK and lived in more places than he can count.

The episode was live-streamed on 17 May 2023 and the video is available at https://youtu.be/W3c4YJ71BOQ

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.https://www.twitch.tv/openobservability https://www.youtube.com/@openobservabilitytalks

Show Notes:

01:44 Spotify Engineering internal need for Backstage

07:09 Backstage and Platform Engineering

10:33 Backstage components: Templates, Catalogue and Plugins

15:31 Why Spotify open-sourced Backstage

21:45 from Spotify’s internal Hack Week to a viral growth

25:19 a perfect community contributed feature in 24 hours

28:48 new Backstages use cases for Banking and healthcare

30:54 Spotify released commercial plugins for Backstage

36:51 How to follow Backstage discussion and Lee Mills

39:08 KubeCon Europe updates

40:51 Prometheus remote-write is standardized