2min chapter

Machine Learning Street Talk (MLST) cover image

#86 - Prof. YANN LECUN and Dr. RANDALL BALESTRIERO - SSL, Data Augmentation, Reward isn't enough [NEURIPS2022]

Machine Learning Street Talk (MLST)

CHAPTER

Are You Using Non-Contrastive Methods?

Randall: I was reading on, you know, Jan's take of contrastive versus non-contrastive in his recent autonomous AI paper. And he was describing the benefits in his view of non-Contrastive methods, kind of shrink wrapping the latent representation. You had a bit of a spicy take yesterday where you're now slightly more skeptical about the need for that. Randall: There are cases where actually the representation will coincide between those two. So it's not a white and black story. It's really, you have a spectrum, let's say. In some regime, it does not matter which method you use,. In some other cases, you might prefer one from the

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode