
#86 - Prof. YANN LECUN and Dr. RANDALL BALESTRIERO - SSL, Data Augmentation, Reward isn't enough [NEURIPS2022]
Machine Learning Street Talk (MLST)
Creating the Adjacency Matrix
Creating an adjacency matrix in self-supervised learning reveals the representational capacity of embeddings. However, needing class labels to create the matrix raises questions. The surrogate task of distorting images in the self-supervised phase helps the final task if the eigenvectors of the two matrices overlap. The robustness of self-supervised representations is a current topic of interest.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.