

767: Open-Source LLM Libraries and Techniques, with Dr. Sebastian Raschka
Mar 19, 2024
Dr. Sebastian Raschka, Author of Machine Learning Q and AI, talks about PyTorch Lightning, LLM development opportunities, DoRA vs LoRA, and being a successful AI educator in a fascinating discussion with Jon Krohn.
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8 9 10
Intro
00:00 • 3min
Exploring 'Machine Learning Q & AI' Book
03:10 • 11min
Data Connect Conference Announcements and Book Pre-order Information
14:12 • 3min
Exploring LLMs and Open-Source Tools with a World-Class Publisher and Writer
17:21 • 12min
Collaboration Capabilities and Cloud Operation in Lightning Studios
29:20 • 3min
Exploring Lightning Studio and Lightning Studios
32:13 • 32min
Exploring Multi-Query Attention vs Multi-Head Attention in Transformer Architectures
01:04:42 • 2min
Training Large Language Models Without Human Feedback
01:06:32 • 35min
Guest Recommendations and Follow-Up Information
01:41:51 • 4min
Exploring Open-Source LLM Libraries and Techniques
01:45:33 • 3min