
Yann LeCun on his Start in Research and Self-Supervised Learning
The Gradient: Perspectives on AI
00:00
The Key Idea Is You Don't Need Negative Pairs
There's a lot of ways for images to be different from each other. And even if the embedding space in the end has the component dimension, it's still hard. So SimClear, for example, takes a very long time to train because of that. You have to use all kind of tricks for hard negative mining and all that stuff. The only one was noise at Target.
Transcript
Play full episode