AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Universal Approximation of Neural Networks
There is truth to what you say on some level, universal approximation of neural networks. So even if a human neuron does something really complicated, as far as we can tell, there's no particular reason that that couldn't be approximated to an arbitrary degree of accuracy by a neural net. Maybe instead of calling it universal approximation, it might be better to call it universal simulation. Right. Well, you can literally say, hey, let's imagine a truly gigantic artificial neural network where groups of what over neurons with 100,000 connections between them each corresponds to a biological neuron and now this whole system can simulate a large number of biological neurons. Do you see what I mean?