AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Scale Hypothesis for AI
There's this idea in AI that is, I think, concisely referred to as the scale hypothesis. If you keep making a model larger and larger and train you in on more and more data then it will advance towards higher levels of intelligence. The question is what happens when we start to gain higher scale from data that is not human in origin. And whether there are new forms of intelligence or emerging intelligent capabilities that are alien and non-human that will emerge there. So do I believe in the scale hypothesis? Yes. But so far it shows no signs of lighting up.