5min chapter

Practical AI: Machine Learning, Data Science, LLM cover image

Multi-GPU training is hard (without PyTorch Lightning)

Practical AI: Machine Learning, Data Science, LLM

CHAPTER

Python Training

Lightning is a refactor on your pytorch project, right? So you basically take your main loop coat. And then there's like a loop, two loops in there,. and then you have in ther four batch in your dadaloder. And then the training step goes all the way from taking your badge into generating a loss that you return with that gradient attached. For production cases, it's literally a function called dot to dots or dot to deothers. It's very simple. There's a m this example on there, and you just run it. You'll notice though, as people will say, well, but werere the advance examples. And my point is

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode