Training Data cover image

Nvidia CTO Michael Kagan: Scaling Beyond Moore's Law to Million-GPU Clusters

Training Data

00:00

Will Inference Run in the Same Data Centers as Training?

Michael explains inference can run on varied scales, discusses SKU specialization for prefill vs decode, and the role of programmability.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app