Vanishing Gradients cover image

Episode 26: Developing and Training LLMs From Scratch

Vanishing Gradients

CHAPTER

Exploring Skills and Challenges in Working with LLMs

Exploring the similarities between training LLMs and deep learning models, emphasizing skills like multi-GPU training, mixed precision training, and model management. Tools like pytorch lightning and fabric are discussed for simplifying the process of handling large models.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner