AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Are You Using Non-Contrastive Methods?
Randall: I was reading on, you know, Jan's take of contrastive versus non-contrastive in his recent autonomous AI paper. And he was describing the benefits in his view of non-Contrastive methods, kind of shrink wrapping the latent representation. You had a bit of a spicy take yesterday where you're now slightly more skeptical about the need for that. Randall: There are cases where actually the representation will coincide between those two. So it's not a white and black story. It's really, you have a spectrum, let's say. In some regime, it does not matter which method you use,. In some other cases, you might prefer one from the