[11] Jacob Andreas - Learning from Language
The Thesis Review
00:00
The Importance of Language in Machine Learning
The general recipe is when I see a new task specified with some amount of training data I'm going to try to identify literally a natural language description of the rule that generates my x's or that transforms my x's into my y's. So if I'm trying to do few shot image classification I'm gonna look at my you know collection of images of birds and say can I come up with a caption for all of these images of birds? And then when somebody comes to me with a new image I just need to ask well is this a good caption for this other image and if so it probably belongs to the same classes all of my training data. It becomes much harder to over
Transcript
Play full episode
