AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Self Supervised Image Representation
There's a really strong argument, i think, that intelligence is generalization. When you look at some of the self supervised image representation learning our grithms flying round at the moment, they do seem to do exactly that. They learn a universal, monolitic vector representation that seems to make sense in a lod of situations. And face books ar the argument that because these things are self supervised, rather than having some pointalistic, human annotated label, it's harder to take a short cut. But as you just said, mark, those categories are probably not universal. I don't see wherer really the hope comes from, the idea that just letting it be self supervised