AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Performance of GPT-4
GPT-4 is an algorithm that you developed with a couple of colleagues back in the 1980s. Many different groups discovered back propagation. The special thing we did was used it and showed that it could develop good internal representations. And curiously, we did that by implementing a tiny language model. It had embedding vectors that were only six components. We can imagine a big layer of those detecting edges in different orientations and different scales all over the image.