TechFirst with John Koetsier cover image

TechFirst with John Koetsier

Solving the GPU shortage: software to 2-4X existing GPU utilization

Sep 12, 2023
18:05

GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.


Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.


The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.


In this TechFirst, we chat about:

- the GPU shortage

- how many GPUs we need

- what Open AI is using right now

- whether OpenAI is getting dumber or not

- and much more


As always, get a full transcript and subscribe to the audio podcast at my website:

https://johnkoetsier.com/category/tech-first/

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode