The Importance of GPUs in Deep Learning

The cost of a single H100 chip is well over 30 grand, so these aren't like very cheap chips. And then you can imagine the complexity then stacks with now we're in a state where companies have trouble even getting access to 10 GPUs because of NVIDIA sort of scarcity issues. So there's like a big need at the time to figure out how do we leverage the hardware properly and that's what we had to build software for.

Transcript

Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app