

Build LLMs From Scratch with Sebastian Raschka #52
Nov 21, 2024
Sebastian Raschka, a Senior Staff Research Engineer at Lightning AI and bestselling author, dives into the art of building large language models. He shares insights on two significant open-source libraries, PyTorch Lightning and LitGPT, that enhance LLM training and deployment. The discussion shifts to his new book, where he outlines essential steps in LLM training and contrasts models like GPT-2 with the latest Llama 3. Sebastian also explores the universe of multimodal LLMs and their potential, highlighting exciting developments on the horizon.
Chapters
Books
Transcript
Episode notes
1 2 3 4 5 6 7 8
Intro
00:00 • 6min
Navigating the Intersection of Academia and Industry in AI
05:46 • 3min
Navigating Ordinal Regression Challenges
08:39 • 5min
From Academia to Industry: A Personal Shift
13:33 • 5min
Revolutionizing Cloud Computing with Lightning AI
18:26 • 5min
Navigating LLMs and PyTorch Lightning
23:01 • 22min
Advancements in Large Language Models
44:47 • 18min
Balancing Focus and Passion in Career Development
01:03:11 • 3min