Eye On A.I. cover image

Terry Sejnowski: NeurIPS and the Future of AI

Eye On A.I.

00:00

Scaling GPUs - Is There an End in Sight?

On the scaling problem, so there's no end in sight in terms of the improvement as you scale parameters. But there is an end in sight, and I think we're close to reaching it in scaling the power required to run the GPUs. And more than the hardware to me, I had a conversation yesterday with a young PhD student about data pruning  and different strategies for identifying what you can throw out and still train efficiently. As you prune the data used for training, you use less power.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app