3min chapter

Practical AI: Machine Learning, Data Science, LLM cover image

Large models on CPUs

Practical AI: Machine Learning, Data Science, LLM

CHAPTER

The Importance of Space and Sparsity in GPUs

Mark O'Mara: I want to follow up on what you're just talking about, which is a really, it's sort of a subtle point. So that's the other thing to call out with the LOMs in terms of GPU versus CPU. What we're trying to do and what we're actually working on right now is making sure we can get thatGPU class speed while maintaining the large memory advantage of CPUs.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode