OpenObservability Talks cover image

OpenObservability Talks

Latest episodes

undefined
Feb 29, 2024 • 1h 5min

Decoding .NET8: Unveiling Cloud-Native Observability - OpenObservability Talks S4E09

The .NET programming language is taking cloud native deployment and observability seriously, and most notably with the recent announcement of .NET Aspire stack unveiled at the recent .NET Conf 2023.  In this episode, we reviewed the open source maintainers’ journey to making .NET a "by default, out of the box observable platform", as ASP.NET Core creator David Fowler put it. David was this episode’s guest, and with him we dived into .NET Aspire and how it simplifies the complexities of cloud app development with capabilities around service discovery, observability, and resilience. We discussed the local developer experience, the path to developer observability, and what we can expect from the upcoming GA release of .NET8. David Fowler has been at Microsoft for 15 years working on developer frameworks and tools in the .NET space. He's one of the creators of several popular OSS frameworks and tools such as NuGet, SignalR and ASP.NET Core, and also architected the Azure SignalR Service. Originally from Barbados, he's an avid open-source advocate and developer currently focused on simplifying developer experiences in the microservice space.  The episode was live-streamed on 21 February 2024 and the video is available at https://www.youtube.com/watch?v=Ll1T9Zs7jUo OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat. https://www.youtube.com/@openobservabilitytalks   https://www.twitch.tv/openobservability⁠⁠ Show Notes: 00:10 - episode and guest intro 04:03 - what .NET used to be like for developing cloud-native 15:10 - out-of-the-box observability in .NET 21:05 - .NET aligning with OpenTelemetry 26:40 - what’s .NET Aspire 32:37 - existing .NET components are part of Aspire 37:46 - developing an observability UI as part of Aspire 43:24 - how to transition containerized apps from dev to prod  48:48 - the relationship between Aspire to Dapr and Radius 53:31 - Aspire roadmap to GA 57:13 - where to follow Aspire and David Fowler 59:13 - K8sgpt accepted to CNCF as a sandbox project 59:56 - Strimzi reaches CNCF incubation with Kafka on Kubernetes 1:00:40 - OpenFeature becomes a CNCF incubating project 1:03:03 - Broadcom kills free ESXi and other VMware restructuring Resources: .NET Aspire GitHub repo: https://github.com/dotnet/aspire  .NET Aspire Preview 3: https://learn.microsoft.com/en-us/dotnet/aspire/whats-new/preview-3  Instrumenting C# .NET apps with OpenTelemetry: https://logz.io/blog/csharp-dotnet-opentelemetry-instrumentation/?utm_source=devrel&utm_medium=devrel OpenTelemetry beginner’s guide: https://logz.io/learn/opentelemetry-guide/?utm_source=devrel&utm_medium=devrel K8sgpt accepted to CNCF sandbox: https://www.linkedin.com/posts/horovits_genai-sre-kubernetes-activity-7158185284289888256-0KuZ Strimzi reaches CNCF incubation: https://www.cncf.io/blog/2024/02/08/strimzi-joins-the-cncf-incubator/ OpenFeature reaches CNCF incubation: https://www.cncf.io/blog/2023/12/19/openfeature-becomes-a-cncf-incubating-project/ Broadcom decided to kill the free edition of ESXi and other VMware restructuring: https://horovits.medium.com/0aea7efafb47 Socials: Twitter:⁠ https://twitter.com/OpenObserv⁠ YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠ Dotan Horovits ============ Twitter: https://twitter.com/horovits LinkedIn: https://www.linkedin.com/in/horovits/ Mastodon: https://fosstodon.org/@horovits David Fowler ========== Twitter: https://twitter.com/davidfowl LinkedIn: https://www.linkedin.com/in/davidfowl Mastodon: https://hachyderm.io/@davidfowl
undefined
Jan 25, 2024 • 1h

Scaling Platform Engineering: Shopify’s Blueprint - OpenObservability Talks S4E08

In this episode, join us as we delve into the intricate world of Platform Engineering with Aparna Subramanian, Director of Production Engineering at Shopify. Discover how Shopify, a powerhouse in e-commerce, masters the art of scaling platform engineering. Gain invaluable insights into their strategies, innovations, and lessons learned while navigating the complexities of sustaining and evolving a robust infrastructure to support millions, even through special peak events like Black Friday and Cyber Monday. If you're keen on understanding the backbone of a thriving online platform, don’t miss out on this episode. Aparna started her career as a Software Engineer and has spent most part of her almost two decades of technology experience specializing in Infrastructure and Data Platforms. In her current role she leads Shopify’s Cloud Native Production Platform. Previously, she was Director of Engineering at VMware where she was a founding member of Tanzu on vSphere, a Kubernetes Platform for the hybrid cloud. She also serves as co-chair of the “CNCF End User Developer Experience” SIG and as member of the CNCF End user technical advisory board. The episode was live-streamed on 11 January 2024 and the video is available at https://www.youtube.com/watch?v=6ShtsTTUizI OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat. https://www.youtube.com/@openobservabilitytalks   ⁠https://www.twitch.tv/openobservability Show Notes: 00:00 - Show intro & 2023 stats 01:49 - Episode and guest intro 04:15 - Shopify’s scale 06:09 - Shopify’s journey to Platform Engineering 08:56 - Shopify’s platform structure 11:49 - division of responsibility 13:51 - golden path vs flexibility 17:58 - balancing flexibility and abstraction 19:56 - platform group structure 23:28 - handling load spikes 28:55 - FinOps in Platform Engineering 38:38 - avoiding silos and the cultural aspect 41:13 - CNCF end-user SIG and community challenges 49:24 - KubeCon Paris and guest contact  51:03 - OpenTofu reached GA 53:33 - Isovalent acquired by Cisco 55:00 - year-end summary articles 57:07 - .NET Aspire released preview2 58:58 - Episode and show outro Resources: Shopify Engineering Blog https://shopify.engineering/ Performance wins at Shopify: https://www.shopify.com/news/performance%F0%9F%91%86-complexity%F0%9F%91%87-killer-updates-from-shopify-engineering CNCF End User SIG https://github.com/cncf/enduser-public OpenTofu has reached GA https://logz.io/blog/terraform-is-no-longer-open-source-is-opentofu-opentf-the-successor/?utm_source=devrel&utm_medium=devrel Observability in 2024: https://thenewstack.io/observability-in-2024-more-opentelemetry-less-confusion/ OpenTelemetry in 2024: https://www.apmdigest.com/2024-application-performance-management-apm-predictions-4 .NET Aspire preview2: https://devblogs.microsoft.com/dotnet/announcing-dotnet-aspire-preview-2/  Socials: Twitter:⁠ https://twitter.com/OpenObserv⁠ YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠ Dotan Horovits ============ Twitter: @horovits LinkedIn: in/horovits Mastodon: @horovits@fosstodon Aparna Subramanian ================= Twitter: @aparnastweets LinkedIn: https://www.linkedin.com/in/subramanianaparna/ 
undefined
Dec 21, 2023 • 1h 1min

Kubernetes and Beyond: A Year-End Reflection with Kelsey Hightower - OpenObservability Talks S4E07

In this special episode we wrapped up the year 2023 with none other than the cloud-native maestro, Kelsey Hightower! We looked into the highs and lows of the tech landscape, exploring Kelsey's insights on containerization and beyond. Tune in as we unravel the year that was and reflect on what lies ahead for Kubernetes and cloud computing. Kelsey has been there since the birth of Kubernetes, with his contributions to the project as well as his advocacy for containers and cloud native tech and concepts. Join us to conclude 2023 with a look above the clouds. The episode was live-streamed on 5 December 2023 and the video is available at https://www.youtube.com/watch?v=OVSIUMJxtLk OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat. https://www.twitch.tv/openobservability https://www.youtube.com/@openobservabilitytalks   Show Notes: 00:00 - Show intro 01:00 - Episode and guest intro 02:40 - Highlights of 2023, signs of maturity 05:17 - Standardizing on cloud bills 12:09 - Consensus vs. innovation in tech 14:46 - Evolution of OpenTelemetry and telemetry signals 19:33 - Where AI will help DevOps and Observability 25:44 - Where is Kubernetes heading in the coming decade 32:42 - Can Kubernetes serve AI/ML workloads 40:37 - CNCF landscape - transparency vs. complexity 49:05 - Evolution of observability 59:03 - Episode and show outro Resources: Standardizing on cloud bills with FOCUS open specification: https://horovits.medium.com/6e30069f33a0 How to fix Kubernetes monitoring: https://thenewstack.io/how-to-fix-kubernetes-monitoring/ Socials: Twitter:⁠ https://twitter.com/OpenObserv⁠ YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠
undefined
Nov 30, 2023 • 1h

KubeCon NA Highlights and Istio Spotlight with Lin Sun - OpenObservability Talks S4E06

Have you missed KubeCon North America in Chicago? This one’s for you! In this episode, we explored the latest and greatest highlights from the event that every tech enthusiast is talking about. From cutting-edge innovations to industry insights, we've got the broad spectrum covered.  But that's not all! We'll also zoomed in on Istio, the popular service mesh open source project that has just recently reached CNCF graduation. Join us as we map out the service mesh universe, and then dive into Istio's galaxy, unraveling its architecture, features, and the roadmap direction with Ambient. And you’ll get to hear it from the Istio authority, Lin Sun. Lin is the Director of Open Source at Solo.io and a CNCF ambassador. She has worked on the Istio service mesh since the beginning of the project in 2017 and serves on the Istio Steering Committee and Technical Oversight Committee. Previously, she was a Senior Technical Staff Member and Master Inventor at IBM for 15+ years. She is the author of the book "Istio Ambient Explained" and co-author of “Istio Explained”, and has more than 200 patents to her name. The episode was live-streamed on 15 November 2023 and the video is available at https://www.youtube.com/watch?v=bxnDH6LH-cA You can read the recap post: https://logz.io/blog/kubecon-na-2023-recap/?utm_source=devrel&utm_medium=devrel OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.https://www.twitch.tv/openobservabilityhttps://www.youtube.com/@openobservabilitytalks   Show Notes: 01:27 - Episode and guest intro 06:34 - KubeCon Highlights: Fluent Bit 09:16 - OpenTelemetry Logging, OTLP is GA 12:53 - OpenTelemetry project journey report 13:43 - WASM Day and Istio Day updates 16:18 - Keynote: the future of Kubernetes 18:51 -Crossplane latest release v1.14  19:24 - Kyverno supports non-Kubernetes workloads 20:12 - Vitess 18 is now GA 20:43 - AI is nascent in CNCF 22:56 - CNCF’s GitOps microsurvey  23:56 - eBPF documentary released 27:08 - Service Mesh architecture and landscape 31:36 - Envoy proxy  33:48 - maturity of the projects 39:36 - Istio unique value proposition and adoption 43:55 - Kubernetes released native sidecar support 47:02 - The GAMMA initiative in Kubernetes Gateway API  50:04 - Istio updates: Ambient, multi-claster, Gateway API GA impl. For N-S  53:40 - CNCF Training & Certification Launch Istio Certification 54:56 - Istio roadmap 56:50 - how to follow Istio and Lin Sun and episode wrapup Resources: KubeCon Updates: https://www.cncf.io/blog/2023/11/07/opentelemetry-at-kubecon-cloudnativecon-north-america-2023-update/ https://opentelemetry.io/blog/2023/http-conventions-declared-stable/ https://www.cncf.io/reports/opentelemetry-project-journey-report/  https://blog.crossplane.io/crossplane-v1-14/   https://www.cncf.io/blog/2023/11/06/kyverno-expands-beyond-kubernetes/  https://planetscale.com/blog/announcing-vitess-18  https://www.cncf.io/blog/2023/11/07/cncf-gitops-microsurvey-learning-on-the-job-as-gitops-goes-mainstream/  Istio Spotlight: https://istio.io/latest/blog/2023/native-sidecars/ https://istio.io/latest/blog/2022/introducing-ambient-mesh/ https://gateway-api.sigs.k8s.io/concepts/gamma/ https://www.cncf.io/announcements/2023/07/12/cloud-native-computing-foundation-reaffirms-istio-maturity-with-project-graduation/  https://istio.io/latest/get-involved/ https://training.linuxfoundation.org/blog/istio-certification/  https://www.oreilly.com/library/view/istio-ambient-explained/9781098142698/ Socials: Twitter:⁠ https://twitter.com/OpenObserv⁠ YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠
undefined
Oct 31, 2023 • 1h 11min

PromCon Recap: Unveiling Perses and Prometheus Ecosystem Updates - OpenObservability Talks S4E05

The latest episode of OpenObservability Talks features Augustin Husson, creator of the Perses project in the Prometheus ecosystem. They discuss exciting announcements from PromCon, including the decision on Prometheus 3.0. They also delve into Perses, a new open source project aiming to revolutionize dashboard visualization and monitoring. Augustin shares his end-user journey and insights as a Prometheus maintainer and principal engineer at Amadeus, a technology vendor for travel agencies. The episode emphasizes the importance of maintainers and contributors in the open source community and discusses challenges and solutions for using Grafana. They also highlight the primary features of the current release of Perses and its journey to join the CNCF. Don't miss out on the lively community engagement and updates on Perses and its development.
undefined
Oct 31, 2023 • 1h

Continuous Observability: Shedding Light on CI/CD Pipelines - OpenObservability Talks S4E02

DevOps is not just about operating the software in production, but also about releasing that software to production. Well-functioning CI/CD pipelines are critical for the business, and this calls for quality observability, to handle broken and flaky pipeline runs effectively. On this episode I hosted Oleg Nenashev, a core maintainer and board member in the Jenkins project, as well as a TOC member in the Continuous Delivery Foundation (CDF). Oleg is a community builder, open source advocate and consultant, now at WireMock Inc. He is also a CDF and CNCF ambassador. We discussed CI/CD, observability, the prominent open source projects and foundations, as well as a new proposal for extending OpenTelemetry to natively support CI/CD observability use cases. The episode was live-streamed on 10 July 2023 and the video is available at https://www.youtube.com/watch?v=FEbyddZFNeo OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat. https://www.twitch.tv/openobservability https://www.youtube.com/@openobservabilitytalks   Show Notes: 00:00 - show intro 01:00 - episode and guest intro 10:08 - what’s new in Jenkins 15:46 - is Jenkins cloud-native? 16:52 - understanding the CI/CD landscape 21:54 - updates from the Continuous Delivery Foundation 27:00 - CI/CD observability support in OpenTelemetry 40:31 - observability with Backstage IDP open source  47:47 - how to contact Oleg 48:51 - State of Continuous Delivery report 52:32 - OTLP 1.0 release and other open standards updates 54:32 - KubeCon will hold a dev-centric event for the first time 55:55 - Jaeger 1.47 is out 57:30 - DevOps Pulse survey insights 58:55 - outro Resources: Observability Has a Complexity Problem (APM Digest) OTLP 1.0 is out Open Standards in observability: updates from KubeCon CI/CD observability support in OpenTelemetry proposal State of Continuous Delivery 2023 report Socials: Twitter:⁠ https://twitter.com/OpenObserv⁠ Twitch: ⁠https://www.twitch.tv/openobservability⁠ YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠ Dotan Horovits ============ Twitter: @horovits LinkedIn: in/horovits Mastodon: @horovits@fosstodon Oleg Nenashev =============== Twitter: @oleg_nenashev LinkedIn: https://www.linkedin.com/in/onenashev/ Mastodon: @asciidwarf@fosstodon
undefined
Sep 21, 2023 • 1h 10min

Terraform is no longer open source. Is OpenTofu the successor? - OpenObservability Talks S4E04

Terraform is no longer open source. This is the news we got last month (August 2023), when HashiCorp announced its decision to relicense its open source tools, including Terraform, Vault, Packer, Consul, Vagrant and others, into Business Source License 1.1. The community, led by active Terraform-based vendors, gathered up to create a fork of Terraform to keep it open. The result is OpenTofu (originally called OpenTF), whose manifesto already has tens of thousands of stars on GitHub, less than a month out. Only a month old, engineers are hard at work to establish the first release of OpenTofu, as well as its foundational backbone. In this month’s episode I covered these significant events that shake our industry and the DevOps world. I was joined by Omry Hay, co-founder and CTO of env0. env0 provides an automation solution based on Terraform, and is one of the creators of OpenTofu and a member of the project’s steering committee. Omry also shared OpenTofu’s mission and current status, as well as exciting updates, hot off Open Source Summit Europe conference taking place these days, in which OpenTofu has officially joined The Linux Foundation. Omry has been a software engineer and engineering manager for the last 16 years, working at companies like eToro, Fiverr and Proofpoint. As CTO of env0, he leads the R&D and Product departments. The episode was live-streamed on 18 September 2023 and the video is available at https://www.youtube.com/watch?v=5QdUs9VKq5g OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat. ⁠https://www.youtube.com/@openobservabilitytalks⁠   https://www.twitch.tv/openobservability Show Notes: 00:00 - show intro 00:56 - episode and guest intro 02:45 - HashiCorp’s relicensing announcement 04:58 - what the relicensing means for users 14:50 - implications on the Terraform ecosystem 24:55 - HCL language for IaC 28:36 - what does the new license mean? 32:13 - Terms of service changed for Terraform Registry 36:08 - forking Terraform and starting OpenTF/OpenTofu 41:08 - how many engineers work on OpenTofu 42:18 - joining the Linux Foundation and renaming OpenTofu 48.50 - OpenTofu release and Terraform compatibility 56:54 - roadmap for OpenTofu 59:00 - how to get touch with the community and Omry 64.30 - The OSI Approved Licenses database is available 65:28 - Red Hat changed the CentOS release process Resources: HashiCorp relicensing announcement: https://www.hashicorp.com/blog/hashicorp-adopts-business-source-licenseOpenTofu project: https://opentofu.org/ The Linux Foundation announces OpenTofu: https://www.linuxfoundation.org/press/announcing-opentofu Red Hat changed the CentOS release process: https://www.redhat.com/en/blog/furthering-evolution-centos-streamCNCF’s guidelines for using source-available dependencies in its OSS projects: https://github.com/cncf/foundation/blob/main/source-available-recommendations.md#recommendations checklist for safely using and choosing open source tools: https://medium.com/@horovits/when-your-open-source-turns-to-the-dark-side-331d83f182c Socials: Twitter:⁠ https://twitter.com/OpenObserv⁠ YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠ Dotan Horovits ============ Twitter: @horovits LinkedIn: in/horovits Mastodon: @horovits@fosstodon Omry Hay ======== Twitter: https://twitter.com/omryhay LinkedIn: https://www.linkedin.com/in/omryhay/
undefined
Aug 31, 2023 • 59min

What's New with Fluentd & Fluent Bit - OpenObservability Talks S4E03

Fluentd and Fluent Bit are two highly popular open source projects for data collection and log forwarding in the realm of observability. Fluentd's flexibility and scalability have led to seamless integration with diverse applications and data sources, while Fluent Bit's lightweight and efficient log forwarding have made it a preferred choice for modern observability pipelines. But Fluent Bit can process more than just logs. The recent release of Fluent Bit v2 added major new integrations with OpenTelemetry, Prometheus and more, as well as extensibility with WebAssembly plugins. On this episode I hosted Eduardo Silva Pereira, one of Fluentd project maintainers and creator of Fluent Bit. He also is the founder of Calyptia, the Fluent company. Eduardo shared with us the latest updates of Fluentd and Fluent Bit, as well as valuable insights into the future roadmap of these projects. The episode was live-streamed on 9 August 2023 and the video is available at https://youtu.be/V02Ctv0Rtg8 OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat. https://www.youtube.com/@openobservabilitytalks   ⁠https://www.twitch.tv/openobservability⁠ Show Notes: 02:11 - Fluentd and Fluent Bit background 09:51 - Should I choose FluentD or Fluent Bit? 13:26 - developing an active engaged OSS community 17:18 - enterprise needs and building commercial offering with Calyptia 19:54 - Fluent Bit v2 updates 29:22 - plugins, filters and processors in Fluent Bit 38:23 - A sneak peak into the planned announcements for KubeCon Chicago 44:16 - where to follow the community and Eduardo 47:43 - Prometheus now supports OTLP 48:57 - PromCon will take place in Berlin, 28-29 Sept. 50:11 - OpenTelemetry Semantic Conventions is separated from the Specification 53:38 - New in Kubernetes 1.27: Query node logs using the kubelet API 54:43 - Kelemetry: global tracing for Kubernetes control plane Resources: Resources ========= Fluent Bit: https://fluentbit.io/ FluentD: https://www.fluentd.org/ Prometheus supports OTLP: https://horovits.medium.com/83f85878e46a PromCon '23: https://promcon.io/2023-berlin/ Query node logs using the kubelet API: https://logz.io/blog/a-practical-guide-to-kubernetes-logging/#Kubernetes_1_27 Kelemetry project: https://www.cncf.io/blog/2023/07/27/kelemetry-global-tracing-for-kubernetes-control-plane/ Socials: Twitter:⁠ https://twitter.com/OpenObserv⁠ YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠ Dotan Horovits ============ Twitter: https://twitter.com/horovits LinkedIn: https://www.linkedin.com/in/horovits/ Mastodon: @horovits@fosstodon.org Eduardo Silva Pereira =============== Twitter: https://twitter.com/edsiper LinkedIn: https://www.linkedin.com/in/edsiper
undefined
Jun 29, 2023 • 1h

​​eBay’s Journey to Planet-Scale Observability with Open Source - OpenObservability Talks S4E01

eBay is a high scale end user of open source observability. Collecting telemetry from millions of endpoints, and running thousands of queries per second, presents serious scaling challenges. eBay has chosen to use an open source stack to meet those challenges. On this episode I hosted Vijay Samuel, Observability Architect at eBay, to hear about the challenges eBay faced in monitoring large Kubernetes installations. We discussed why eBay chose the open source stack, and the strategic decision behind eBay's migration from Elastic Beats to OpenTelemetry, and the remarkable experiences they had while deploying massively large scale telemetry installations using OpenTelemetry and Prometheus. We also discussed a fascinating new proposal for a query language standard for observability, which eBay spearheads together with Netflix under the auspices of the CNCF’s TAG Observability (the CNCF’s technical advisory group for observability). The episode was live-streamed on 8 June 2023 and the video is available at https://www.youtube.com/watch?v=-UsU3nRglhA OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat. https://www.twitch.tv/openobservability https://www.youtube.com/@openobservabilitytalks   Show Notes: 3rd anniversary eBay monitoring solution  planet scale at eBay in numbers distributed tracing at eBay migrating from Elastic Beats to OpenTelemetry why eBay chose open source  open-sourcing eBay’s metrics store platform? scaling Prometheus ramping up tracing, from backend to frontend and mobile running OpenTelemetry Collector at scale Query Language Standardization for Observability under the CNCF Resources: New CNCF working group for Observability Query Language Standardization: https://github.com/cncf/tag-observability/blob/main/working-groups/query-standardization.md Why and How eBay Pivoted to OpenTelemetry: https://tech.ebayinc.com/engineering/why-and-how-ebay-pivoted-to-opentelemetry/ Socials: Twitter: https://twitter.com/OpenObserv Twitch: https://www.twitch.tv/openobservability YouTube: https://www.youtube.com/@openobservabilitytalks Dotan Horovits ============ Twitter: @horovits LinkedIn: in/horovits Mastodon: @horovits@fosstodon Vijay Samuel ========== Twitter: @vjsamuel_ LinkedIn: vjsamuel
undefined
May 31, 2023 • 47min

From Spotify to Open Source: The Backstory of Backstage - OpenObservability Talks S3E12

With over 1,000 companies using it and 21.5K+ stars on GitHub, the Backstage open source project is quickly becoming a go-to tool for managing developer infrastructure. In this episode, I’ll sit down with Lee Mills, a Senior Engineering Manager from Spotify's Backstage project, to learn more about how the open source platform is revolutionizing the developer experience and how it aligns with the growing Internal Developer Platform (IDP) space. We’ll discuss the need that drove Spotify to build this internal tool, about the decision and journey to open source it and donate it to the CNCF (Cloud Native Computing Foundation). We’ll also discuss the new commercial plugins, what’s coming up on the roadmap, and much more.  Lee has worked as an engineering manager for the past 12 years, from Amazon to Spotify and everything in between. Prior to that Lee had a mixed background working in academia as a lecturer, worked as a Boom Op for television in the UK and lived in more places than he can count. The episode was live-streamed on 17 May 2023 and the video is available at https://youtu.be/W3c4YJ71BOQ OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube. We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.https://www.twitch.tv/openobservabilityhttps://www.youtube.com/@openobservabilitytalks   Show Notes: 01:44 Spotify Engineering internal need for Backstage 07:09 Backstage and Platform Engineering 10:33 Backstage components: Templates, Catalogue and Plugins 15:31 Why Spotify open-sourced Backstage 21:45 from Spotify’s internal Hack Week to a viral growth 25:19 a perfect community contributed feature in 24 hours 28:48 new Backstages use cases for Banking and healthcare 30:54 Spotify released commercial plugins for Backstage 36:51 How to follow Backstage discussion and Lee Mills 39:08 KubeCon Europe updates 40:51 Prometheus remote-write is standardized 41:32 Sunsetting OpenCensus 42:31 ECS to merge with OpenTelemetry specification 43:22 progress to stabilize Logs in OpenTelemetry 45:02 MicroProfile v6.0 support OpenTelemetry Traces 45:40 Grafana 9.5 release Resources: Backstage website: https://backstage.io  Kubecon Europe 2023 talk: The State of Backstage in 2023: https://youtu.be/vskefrlvocE  Kubecon Europe 2023 talk: Lunar building an internal compliance platform using Backstage: https://youtu.be/6T3Mf6pdg7E Backstage accepted as CNCF incubation project: https://www.cncf.io/blog/2022/03/15/backstage-project-joins-the-cncf-incubator/ Socials: Twitter: https://twitter.com/OpenObserv Twitch: https://www.twitch.tv/openobservability YouTube: https://www.youtube.com/@openobservabilitytalks Dotan Horovits ============ Twitter: @horovits LinkedIn: in/horovits Mastodon: @horovits@fosstodon Lee Mills =============== LinkedIn: https://www.linkedin.com/in/codetoy Mastodon: @leem@mastodon.social

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode