AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is There a Need for New Architectures?
The feed forward piece is actually the closest thing to like the classical neural network in this entire architecture. So it's basically a bunch of little guys called neurons, which have that nonlinear, what's called an activation function inside of them. And again, like it sounds complex, but if you're in the field for a while, this is actually surprisingly simple. But generally speaking, I know technical people in general are looking for simple things that work surprisingly well rather than elegantly constructed complex things.