Training Data cover image

Nvidia CTO Michael Kagan: Scaling Beyond Moore's Law to Million-GPU Clusters

Training Data

00:00

Will Inference Run in the Same Data Centers as Training?

Michael explains inference can run on varied scales, discusses SKU specialization for prefill vs decode, and the role of programmability.

Play episode from 21:01
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app