AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How Much Knowledge Is Required?
I don't even know how to measure an answer to that question. I'm not sure how to measure it, but whatever it is, it fits in about 800,000 neurons, 800 million neurons, or the representation does. A dog is 2 billion, but a cat is less than 1 billion. So multiply that by a dozen and you get the number of synapses. And I think almost all of it is learned through this sort of self-supervised running. But it's driven by the sort of objective functions that a cat or a human have at the base of their brain which kind of drives their behavior.