Episode 20: Hattie Zhou, Mila, on supermasks, iterative learning, and fortuitous forgetting
Generally Intelligent
00:00
The Zero Values Are Relevant Still. Is That Really a Good Idea?
In context learning or prompting could be a very good way of doing this. If we know how to use it properly, I think. Masking is kind of like an alternative to in-context prompting. Yeah, much more difficult alternatives. It's a little harder. We understood a little bit better, but there's definitely still a lot that we don't understand. The zero values are actually relevant still. And that's maybe one reason 902.30 is a way to identify lottery tickets.
Transcript
Play full episode
