
Currents 036: Melanie Mitchell on Why AI is Hard
The Jim Rutt Show
00:00
Is It a Neural Network?
It's a kind of a neural network. It learns, basically from text. And it learns by completing sentences. If i give you a sentence like a, i drove the car to the blank, and you can fill that in with different words,. Certain words make sense, like store or building or something, but other words, like avacato or magenta don't make sense in that context. So the machine learns to figure out what words make sense in certain contexts. But it learns that way from billions of documents. I mean, it's hard for us to even imagine how how much text it's learning from and how many neural network weights are in this network.
Play episode from 27:18
Transcript


