767: Open-Source LLM Libraries and Techniques, with Dr. Sebastian Raschka
Super Data Science: ML & AI Podcast with Jon Krohn
00:00
Exploring Lightning Studio and Lightning Studios
The chapter delves into Lightning Studio and Lightning Studios, detailing their similarities to Colab and NanoGPT. It discusses the evolution of Lightning Studios to support various model types and emphasizes simplicity and minimalism in code structure. The conversation also covers open-source libraries for developing human-readable code in deep learning models and explores techniques like Dora for parameter efficiency in fine-tuning large language models.
Transcript
Play full episode
