The Connection Between Large Language Models and Emergence

5min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

There's no principle that anyone has ever advocated in favor of that says that every imaginable path is a priori equally likely. The universe obeys patterns, which implies that its evolution in the real world describes a very, very, very tiny and special subset of all conceivable evolutionsthat it could. I'm not moved by the idea that these large language models are actually not just learning what to say next, but learning what things mean,. or more specifically that they are implicitly forming a picture of the world in their minds.

Welcome to the June 2023 Ask Me Anything episode of Mindscape! These monthly excursions are funded by Patreon supporters (who are also the ones asking the questions). We take questions asked by Patreons, whittle them down to a more manageable number -- based primarily on whether I have anything interesting to say about them, not whether the questions themselves are good -- and sometimes group them together if they are about a similar topic. Enjoy!

Post with questions and full transcript: https://www.preposterousuniverse.com/podcast/2023/06/05/ama-june-2023/

Support Mindscape on Patreon.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.