AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How Do You Make Up Numbers for Words?
In Wolfram language, there's a function called feature space plot that will take a bunch of things and try and arrange them according to their features in some way so that things which have similar features are nearby. In chat GPT, the thing that is really useful to do is to make up not just individual numbers for words, but for every word you have a whole collection of numbers. And those embeddings, those learnt embeddings that you deduce from looking at text can tell you tons of stuff about how sentences work. We could swap crocodile for alligators because they appear in similar places on the page. Those mappings would be valuable if we wanted to learn more about