What's AI Podcast by Louis-François Bouchard cover image

What is a deep learning architect. With Adam Grzywaczewski (NVIDIA) - What's AI Podcast Episode 4

What's AI Podcast by Louis-François Bouchard

00:00

How to Scale Large Models and Data Sets?

The company has published high-term parameters for models up to 175 billion parameters. And it will scale perfectly as long as you have the right hardware, so by perfect meaning, so that's another problem. The amount of hardware needed can be scary if you think about how much my car costs. But then a typical large company, sometimes in a canteen, will spend the same amount of money on sandwiches in a year. What it takes to train those models in electricity. So those are not as challenging problems as you might think.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app