Kubernetes Podcast from Google cover image

Kubernetes Podcast from Google

65k nodes on GKE, with Maciej Rozacki and Wojciech Tyczyński

Nov 13, 2024
In this engaging discussion, Maciej Rozacki, a Product Manager for AI training at GKE, and Wojciech Tyczyński, a Software Engineer focused on Kubernetes scalability, delve into the monumental support for 65,000 nodes on GKE. They share insights on the innovations that enabled this leap, the complexities of managing large clusters, and how these advancements cater to AI workloads. The duo also emphasizes the importance of open-source contributions and community engagement in shaping the future of Kubernetes scalability.
48:46

Podcast summary created with Snipd AI

Quick takeaways

  • GKE's increase to 65,000 supported nodes addresses the extensive resource demands of AI and ML workloads, enhancing computational scalability.
  • The integration of training and serving workloads within the same GKE cluster optimizes resource usage, improving efficiency for AI applications.

Deep dives

Scaling Kubernetes to 65,000 Nodes

GKE has announced a significant increase in supported cluster size, moving from 15,000 to 65,000 nodes. This advancement is driven by the growing demand for large-scale computing power for artificial intelligence (AI) and machine learning (ML) models, which often require extensive resources for training and serving. The new cluster capacity is aimed at accommodating models with potentially trillions of parameters, highlighting the need for scalable infrastructure to address evolving AI workloads. By narrowing the use case to predominantly AI-related applications, GKE aims to enhance the ability to manage such massive clusters efficiently.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode