AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of Hierarchy in Deep Learning
In the transformer level, you know, model that's behind chat GPT and and Google's bar, they're like close to 100. Unsupervised neural networks work in the same way as the brain and they extract these features like edges and corners from a hierarchy. So that's the way that we think that the brain is kind of constructing our model of the world. It must emerge at some of these kind of higher levels in the hierarchy," he says.