Kubernetes Podcast from Google KubeCon EU 2025
May 15, 2025
Hear about the rise of platform engineering and its application in unique settings, like dairy farms! Discover the innovative Kubernetes Gateway API and its impact on traffic management. Dive into advancements in auto-instrumentation and the challenges of managing Kubernetes environments. Gain insights on deploying large language models and practical solutions showcased at the event. Plus, explore the evolving role of Kubernetes in AI and machine learning, highlighting automation in everyday tasks and its adaptability across various sectors.
AI Snips
Chapters
Books
Transcript
Episode notes
Build Platforms for Real Needs
- Start by identifying a real pain point your platform solves before building it.
- A platform should be a helpful product users want, not something forced on them.
Autoscale LLMs on Real Bottlenecks
- For LLM workloads, auto-scale based on custom metrics like tokens per second or GPU usage, not just CPU or RAM.
- This targets scaling to the real bottleneck in resource-intensive AI inference tasks.
Etcd Operator and Release Update
- Ivan Valdez became co-chair of SIG etcd and announced etcd 3.6 release.
- The new etcd operator aims to simplify running standalone etcd clusters inside Kubernetes.
