Vanishing Gradients cover image

Episode 26: Developing and Training LLMs From Scratch

Vanishing Gradients

00:00

Exploring Skills and Challenges in Working with LLMs

Exploring the similarities between training LLMs and deep learning models, emphasizing skills like multi-GPU training, mixed precision training, and model management. Tools like pytorch lightning and fabric are discussed for simplifying the process of handling large models.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app