AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Belief in Large Networks
TPA3 is good for processing sequences of vectors. If you're processing 2,000 words, one way to think about that is you're really processing a sequence of vectors. This brings us to the third point you made about why it would have been hard to build something like TPA3 five years ago - just this belief in large networks. Why did people not believe that large networks would give them such a big advantage? And why was it that you and your colleagues open AI thought otherwise?