Neural Networks and Physics

There's a close mathematical relationship between artificial neural networks and concepts in physics like the renormalization group. A simple neural network can differentiate between cat and dog pictures, a task seemingly impossible due to the vast number of possible images (2 to the power of one million, if each pixel is black or white). This implies that while neural networks can solve some problems very well, most problems are unsolvable with reasonably sized networks.