
Episode 549: William Falcon Optimizing Deep Learning Models
Software Engineering Radio - the podcast for professional software developers
00:00
Getting Rid of Boilerplate in PyTorch
The lightning module is an organization layer in PyTorch. It's not an abstraction, right? So it's only organized in the code. By doing that, you're getting rid of a lot of boilerplate. In 2021, I think, or 2020, we introduced GPT to help with large data sets. The problem was scaling that model to that much data actually requires a lot of engineering. That engineering is usually handled by the trainer in lightning.
Transcript
Play full episode