Gradient Dissent: Conversations on AI cover image

Exploring PyTorch and Open-Source Communities with Soumith Chintala, VP/Fellow of Meta, Co-Creator of PyTorch

Gradient Dissent: Conversations on AI

00:00

The Importance of Compiling a Deep Learning Model

The compiled execution model in 2015 did not buy you very much for two reasons. The accelerators primarily at the time were NVIDIA GPUs and they were already being saturated by eager execution mode. As of today, the compilers have gotten sophisticated and mature enough that they are able to extract a lot more performance out of a compiled model. But now you're forced to compile or else you're just going to be memory bandwidth bound.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app