Vanishing Gradients cover image

Episode 26: Developing and Training LLMs From Scratch

Vanishing Gradients

CHAPTER

Exploring the Power of Large Language Models

In this chapter, the speakers express their excitement for attending a sci-fi conference before diving into the intricacies of coding LLMs from scratch for real-world applications. They stress the importance of hands-on experience and understanding the basics to advanced applications of LLMs. The conversation delves into the benefits and drawbacks of using one large language model for all tasks versus multiple specialized models, exploring examples from various fields and discussing the process of continued pre-training for optimal model performance.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner