AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Getting Rid of Boilerplate in PyTorch
The lightning module is an organization layer in PyTorch. It's not an abstraction, right? So it's only organized in the code. By doing that, you're getting rid of a lot of boilerplate. In 2021, I think, or 2020, we introduced GPT to help with large data sets. The problem was scaling that model to that much data actually requires a lot of engineering. That engineering is usually handled by the trainer in lightning.