Kubernetes Podcast from Google cover image

Observability & Engineering Management, with Charity Majors

Kubernetes Podcast from Google

CHAPTER

Importance of Understanding Engineering Management and Observability in AI and ML Workloads

This chapter emphasizes the significance of learning about engineering management for all professionals, not just those on a management track, to effectively communicate with managers and support team well-being. It also discusses observability tools like Honeycomb.io, showcasing Observability 2.0 for better question answering. Moreover, it touches on monitoring resources efficiently for AI and ML workloads, proposing the building of LLM gateways within Kubernetes and the need to manage traffic specific to LLMs for quality assurance and scaling.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner