Large models on CPUs (Practical AI #221)
Changelog Master Feed
00:00
The Importance of GPUs for Large Models
The CPU and the GPU are about equivalent in terms of computer, but because with the sparsity and the dynamic setup of CPUs, we can run and skip all those zero multiplications. So overall, it works out that you can actually beat the GPUs and that set up with just pure software. It was a barrier that we had especially early on a couple of years back where it took a lot of convincing to even get in the door to talk to anyone because they just didn't believe what we were saying. Now it's gotten quite a bit better, especially with the newer software that's been pushed out of the newer chipsets onCPU.
Transcript
Play full episode
