AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
2min snip
Generative AI on Kubernetes
Kubernetes Bytes
Installing NVIDIA Toolkit and Kubernetes for GPU Workloads
The journey began with setting up a system from scratch, installing Ubuntu, NVIDIA drivers, and Docker, celebrating the successful installation at 2 AM. Next, the NVIDIA container toolkit was installed to enable Docker and container D to utilize CUDA and NVIDIA drivers. Subsequently, a NVIDIA container runtime validation was done through a Docker run command. Following this, upstream Kubernetes was installed, preferring it over other flavors. Setting up a single node Kubernetes with Selium as the CNI was completed, and the NVIDIA GPU operator was installed to connect Kubernetes with the container runtime. The final step involved running an Ubuntu 2020 image as a pod in Kubernetes to verify NVIDIA SMI, creating three layers of abstraction for GPU utilization.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode