Kubernetes Bytes cover image

Kubernetes Bytes

Building the AI Hyperscaler with Kubernetes

Jun 28, 2024
Brandon Jacobs, Infrastructure architect at Coreweave, discusses how Coreweave uses Kubernetes to build an AI hyperscaler. They cover managing Day 0 & 2 operations for AI labs, lessons learned, and best practices for a Kubernetes based cloud. Topics include leveraging bare metal Kubernetes for GPU workloads, storage options for AI labs, observability, monitoring, handling CVEs, and customer cluster support.
54:56

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • CoreWeave uses Kubernetes for AI hyperscaler on bare metal, focusing on efficient cloud platforms.
  • Observability and monitoring are key priorities for CoreWeave, sharing security responsibilities with customers.

Deep dives

Kubernetes Bites Podcast Overview

The Kubernetes Bites podcast delves into topics surrounding cloud-native data management, featuring hosts Ryan Walner, Bob, and Shaw from Boston. They cover recent news, interviews with industry experts, and practical experiences in managing data in cloud-native ecosystems. Learn about the diverse range of guests sharing insights on Kubernetes and cloud platforms.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner