The main way that systems like Chat GPT are trained is by doing basically autocomplete. But OpenAI added something else on top of this autocomplete tool. Workers, often underpaid workers outside of the US spend tons of hours labeling potentially toxic material. And they also had workers say whether they liked full responses, not just individual words anymore. This kind of training has allowed Chat GPT to create more complicated, more coherent responses.
AI has the potential to impact our society in dramatic ways, but researchers can’t explain precisely how it works or how it might evolve. Will they ever understand it?
This is the first episode of our new two-part series, The Black Box.
For more, go to http://vox.com/unexplainable
It’s a great place to view show transcripts and read more about the topics on our show.
Also, email us! unexplainable@vox.com
We read every email.
Support Unexplainable by making a financial contribution to Vox! bit.ly/givepodcasts
Learn more about your ad choices. Visit podcastchoices.com/adchoices