Unsupervised Learning Ep 7: Co-Creator of Databricks Dolly Mike Conover on Open-Source LLMs
4 snips
May 11, 2023 Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Introduction
00:00 • 5min
Dolly: A General Purpose Instruction Following Behavior
04:57 • 3min
The Four Minute Mile: The Existence Proof of Chat GPD
08:06 • 4min
The Importance of Data Curation in the Enterprise
11:59 • 3min
The Importance of Labeled Data in Chat GPT
14:47 • 4min
The Pre-Training Paradigm
19:02 • 4min
The Future of Instruction Fine-Tuning Data
22:39 • 5min
The Importance of Data Labeling in Machine Learning
27:13 • 5min
The Unreasonable Effectiveness of Data
31:54 • 3min
Photoshop for Text
35:11 • 2min
The Future of Machine Learning Infrastructure
37:09 • 5min
The Importance of Context in Machine Learning
42:04 • 3min
The Importance of Humanity
44:35 • 2min
The Power of Self-Awareness
46:13 • 2min