BI 123 Irina Rish: Continual Learning
Brain Inspired
00:00
Scaling and Inductive Biase?
The question is, what inductive biases help to improve scaling? And that's a good question. Cuplan was presenting at our workshop a couple of times. He mentioned that in his experience again, for that setting, that problem for gipty tre improvements due to architecture did not seem to be as significant as just a kind of scaling. It doesn't completely kind of exclude tisitation when inductive biases may be sumed for some other problems would be much more important. How do you explore the full space of architecture? You have some sum limited amount of exploration, nit right? Am, that’s a good question, i meani, just like wis everything n
Transcript
Play full episode
