The Importance of Emergence in AI

The ability to synthesize across vastly different domains of knowledge is just astounding, really. Some critics say some of these abilities that seem so impressive happen because all this information was just in the training data for the large language model. So there's kind of a middle ground you can take and say, well, there really are doing something new and novel that's unexpected. But it's going beyond what was expected.