AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
2min chapter
Large models on CPUs
Practical AI: Machine Learning, Data Science, LLM
The Importance of GPUs for Large Models
The CPU and the GPU are about equivalent in terms of computer, but because with the sparsity and the dynamic setup of CPUs, we can run and skip all those zero multiplications. So overall, it works out that you can actually beat the GPUs and that set up with just pure software. It was a barrier that we had especially early on a couple of years back where it took a lot of convincing to even get in the door to talk to anyone because they just didn't believe what we were saying. Now it's gotten quite a bit better, especially with the newer software that's been pushed out of the newer chipsets onCPU.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode