6min chapter

The Stephen Wolfram Podcast cover image

Stephen Wolfram Answers Live Questions About ChatGPT

The Stephen Wolfram Podcast

CHAPTER

How Do You Make Up Numbers for Words?

In Wolfram language, there's a function called feature space plot that will take a bunch of things and try and arrange them according to their features in some way so that things which have similar features are nearby. In chat GPT, the thing that is really useful to do is to make up not just individual numbers for words, but for every word you have a whole collection of numbers. And those embeddings, those learnt embeddings that you deduce from looking at text can tell you tons of stuff about how sentences work. We could swap crocodile for alligators because they appear in similar places on the page. Those mappings would be valuable if we wanted to learn more about

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode