145: Unsupervised Machine Learning
Programming Throwdown
Dolly From Open AI
Dolly is a model that reconstructs things by putting them into this big cube. And then you can just do more and more things on that cube so if you look at Dolly from open AI. This is what they did so they trained a model on Wikipedia to predict the next word of the sentence like I described. Then they trained another model on images. And then they created another thing which said, I have captions for images. Those two points should be close together. And then I'm going to take captions that don't belong with their picture mismatched caption picture pairs. And those points should be far apart. She's using all three of them to generate that picture of
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
