No Priors: Jensen Huang, Founder & CEO of Nvidia
Code Story: Insights from Startup Tech Leaders
00:00
The Hopper H100: A Workhorse for AI
Big breakthrough for Hopper is recognizing that quantization, the numerical quantization has a fair amount of innovation and ability to reduce. 8-bit floating point rather than if you look at scientific computing today, 64-bit Floating Point. And so just by breaking up 64-bit into 8, you could increase the performance of an AI supercomputer just by a factor of 8 by not doing 64-bit. So that's almost a factor of, if you're a well factor of 10 almost in just a couple of generations just by recognizing that 64-bit wasn't necessary.
Transcript
Play full episode
