Neural Networks - What Kind of Optimization Problems Should I Submit?

Every neural network is uses gradient based optimization. There are other problems that use it as well but within neural networks all of the kind of big steps that we've seen all the big changes have been neural networks recently. So any optimization problem you could theoretically as long as it's differentiable and can use the chain rule to flow back it could use gradients. But fundamentally you could do it with a neural network if you wanted to it just might be a bit worse.

Transcript

Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app