In Machines We Trust: A conversation with Geoffrey Hinton (Live)
MIT Technology Review Narrated
00:00
The Performance of GPT-4
GPT-4 is an algorithm that you developed with a couple of colleagues back in the 1980s. Many different groups discovered back propagation. The special thing we did was used it and showed that it could develop good internal representations. And curiously, we did that by implementing a tiny language model. It had embedding vectors that were only six components. We can imagine a big layer of those detecting edges in different orientations and different scales all over the image.
Transcript
Play full episode
