Will Biology Play a Role in Optimization?

In evolution, the brain spent a lot of time fighting the fact it was dealing with very slow components. And so in machines, we have much less of this problem. We should be inspired by the brain because there's lots of really good ideas in there and so on. But it's not clear that we're really solving the same problem. Backprop is a common is a hierarchy of such gradients,. There is a series of such gradient and things like reinforcement learning or more are very much a feedback version of some such gradients.

Transcript

Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app