
Episode 20: Hattie Zhou, Mila, on supermasks, iterative learning, and fortuitous forgetting
Generally Intelligent
The Zero Values Are Relevant Still. Is That Really a Good Idea?
In context learning or prompting could be a very good way of doing this. If we know how to use it properly, I think. Masking is kind of like an alternative to in-context prompting. Yeah, much more difficult alternatives. It's a little harder. We understood a little bit better, but there's definitely still a lot that we don't understand. The zero values are actually relevant still. And that's maybe one reason 902.30 is a way to identify lottery tickets.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.