Alex Tamkin on Self-Supervised Learning and Large Language Models
The Gradient: Perspectives on AI
00:00
The Importance of Input Dependent Views
You can't actually output some of the most common perturbations, like cropping or flipping. What you can do is generate a whole bunch of maybe more diverse and strange image based perturbations. And so we'll have some follow up work showing some cases where this is really useful to add input dependent views.
Transcript
Play full episode
