Ep 7: Co-Creator of Databricks Dolly Mike Conover on Open-Source LLMs
Unsupervised Learning
00:00
The Pre-Training Paradigm
I feel like the community has shown that fine tuning these models is remarkably effective, right? You know, it seems like mosaic and others are still training from scratch. I think you're going to have a lot of businesses standing up services in their sort of secure environments with their fine-tuned models just doing real work for the business. And so the fine tunes seem like a point in time, but many more of them than the pre-trains.
Transcript
Play full episode
