The GPT is based on a vocabulary of 50,000 words. It looks at some words from the text and finds similar words in real text that it was provided to figure out how it figures out what to produce next. The model randomly selects which word to come next by voting for each one. Jesse: How many words do you think this system knows?
Are new AI technologies like ChatGPT about to massively disrupt our world? Drawing from his recent New Yorker article on the topic, Cal explains exactly how programs like ChatGPT work, and uses this knowledge to explain why we can calm our fears about this new technology.
Below are the questions covered in today's episode (with their timestamps). Get your questions answered by Cal! Here’s the link: https://bit.ly/3U3sTvo