AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of the Imaginal in Deep Learning
Jeffrey Hinton: The system disconnects from the world and it generates fantasies, variations on those invariants. It sensitizes the recognition system to sort of initially look for those patterns then most of them get killed off. But some of them survive and you get a nuance, a complexification of the inviolability that are picked up from the world. And so it's imaginal that way. Now you pay the price that there is actually small deviations in the hue of the wall, but you don't care. So fantasizing is not ornamental. It is indispensable to the system actually evolving its pattern detecting abilities.