AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Connection Between Large Language Models and Emergence
There's no principle that anyone has ever advocated in favor of that says that every imaginable path is a priori equally likely. The universe obeys patterns, which implies that its evolution in the real world describes a very, very, very tiny and special subset of all conceivable evolutionsthat it could. I'm not moved by the idea that these large language models are actually not just learning what to say next, but learning what things mean,. or more specifically that they are implicitly forming a picture of the world in their minds.