Jaeger V2 Unveiled: Powered by OpenTelemetry - OpenObservability Talks S5E05
Oct 28, 2024
auto_awesome
Yuri Shkuro, observability engineer at Meta and creator of Jaeger, dives into the groundbreaking Jaeger V2 release, emphasizing its deep integration with OpenTelemetry. He discusses the architectural advancements and enhanced user interface, making tracing more efficient. Yuri highlights future UI enhancements and community mentorship's role in Jaeger's growth. Additionally, he touches on the complexities of observability in machine learning, showcasing how OpenTelemetry addresses these challenges.
Jaeger V2 showcases a significant architectural shift with deep OpenTelemetry integration, enhancing flexibility and performance in distributed tracing.
The introduction of the OpenTelemetry Protocol (OTLP) for data ingestion reflects Jaeger's commitment to standardization and broader community engagement.
Community-driven initiatives, such as mentorship programs, have been pivotal in advancing Jaeger's functionality and facilitating new contributor involvement.
Deep dives
Significance of Open Source Observability Day
Open Source Observability Day is highlighted as an upcoming virtual community conference dedicated to open source observability. This free event is scheduled for October 24th, 2024, and features several prominent speakers including experts from Honeycomb, Victoria Metrics, and Percona. The host is excited to present a talk on OpenTelemetry during this conference. This event represents an opportunity for the community to engage, learn, and share insights on impactful observability practices.
Introduction to Jaeger and Its Evolution
Jaeger, initially developed as an internal tool at Uber, has matured into an open-source project under the Cloud Native Computing Foundation (CNCF). As a graduated project, it is acknowledged alongside significant technologies like Kubernetes and Prometheus. The conversation covers the anticipation surrounding Jaeger V2, which marks the second major release after years of enhancements and community input. The guest speaker, Yuri Skoro, a key figure in Jaeger's development, shares insights on the journey and advancements made in tracing technology.
Key Updates and Features in Jaeger V2
Jaeger V2 introduces several significant updates, especially in its integration with OpenTelemetry. The new version defaults to supporting the OpenTelemetry Protocol (OTLP) for data format, which streamlines the data ingestion process and enhances compatibility. The deprecation of Jaeger SDKs indicates a strategic shift toward standardization with OpenTelemetry, capturing a broader developer community's momentum. Furthermore, improvements in the user interface and functionality, such as uploading OpenTelemetry data files, demonstrate Jaeger's commitment to evolving with industry standards.
Architectural Changes and Enhanced Backends
A major architectural change in Jaeger V2 focuses on using the OpenTelemetry Collector to enhance its back-end capabilities. This change allows Jaeger to utilize flexible data pipelines, facilitating better data management and processing efficiencies. Jaeger's support for external storage integrations, such as Cassandra and Elasticsearch, allows organizations to leverage their existing database expertise without the need to manage a bespoke database solely for traces. The shift toward batch processing in the new storage model aims to significantly improve data ingestion performance.
Community Engagement Through Mentorship Programs
The podcast emphasizes the importance of community-driven efforts in Jaeger's development, particularly through mentorship programs. These programs have provided opportunities for new contributors to work on strategic projects, enhancing the functionality and reach of Jaeger. As a result, several improvements and necessary updates, especially related to the UI and storage backends, have been achieved. This collaborative approach underscores the power of community involvement in open-source projects and the continuous evolution of Jaeger.
In this episode of OpenObservability Talks, Dotan Horovits sits down with Yuri Shkuro, the creator of Jaeger, to unveil the highly anticipated Jaeger V2. This major release introduces a new architecture with deep OpenTelemetry integration, which promises more flexibility, performance, extensibility and ease of use. Join us as Yuri shares insider details on the challenges, innovations, and roadmap for Jaeger V2 towards a more efficient and scalable distributed tracing solution.
Yuri is a software engineer who works on distributed tracing, observability, reliability, and performance problems, currently working at Meta; author of the book "Mastering Distributed Tracing"; creator of Jaeger, an open source distributed tracing platform originally developed at Uber; co-founder of the OpenTracing and OpenTelemetry CNCF projects; member of the W3C Distributed Tracing Working Group.
OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.
We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.
