Episode 20: Hattie Zhou, Mila, on supermasks, iterative learning, and fortuitous forgetting
Generally Intelligent
Is There a Trick for Generalization?
What makes an example easy but it's hard? That's a good question, I think if the example is very typical of a class and it doesn't have a lot of weird features, then in order to classify that example, all you need are the common features of that class. Although that would depend on like which examples it's seen. And that later I've found in the forgetting paper actually that that process is helpful for generalization. So yes, I think the answer is yes.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
