AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Limitations of Deep Learning
I share some of your intuitions about the limitations you expressed about deep learning. But at the same time, it's worth mentioning there does seem to be something kind of fascinating and nuanced occurring in these networks when trained at scale. I think that in many cases, you can get effective generalization sort of without going all the way to the full expressive power of programming languages or first order logic. And certainly, we don't understand all of it, which is a problem in its own right that also deserves a lot of work.