Ep 7: Co-Creator of Databricks Dolly Mike Conover on Open-Source LLMs
Unsupervised Learning
00:00
The Importance of Data Curation in the Enterprise
The composition of instruction tuning data will shape the resultant model behaviors. We hosted chain for a talk, one of the authors on that paper for a talk and like it's 1,800 or so different task demonstrations. And I think what happens is that in order to effectively compress all of the required behaviors, these models learn an internal representation of the world.
Transcript
Play full episode
