A neural network is a mathematical abstraction of the brain. It's basically a sequence of matrix multiplies, which are really dot products mathematically and some nonlinearities thrown in. The idea is like we need to find the setting of the knobs that makes the neural net do whatever you want it to do. And so there's not too much mystery, I would say in it.