4min chapter

Eye On A.I. cover image

Terry Sejnowski: NeurIPS and the Future of AI

Eye On A.I.

CHAPTER

Scaling GPUs - Is There an End in Sight?

On the scaling problem, so there's no end in sight in terms of the improvement as you scale parameters. But there is an end in sight, and I think we're close to reaching it in scaling the power required to run the GPUs. And more than the hardware to me, I had a conversation yesterday with a young PhD student about data pruning  and different strategies for identifying what you can throw out and still train efficiently. As you prune the data used for training, you use less power.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode