AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Overcome the Barrier to GP3
The better you understand the whole mystery novel, the more ability you have to predict that next word. So it's sort of operationalizes understanding in a way that we can actually optimize for? Precisely. GPT3 is not a small neural network in terms of the amount of compute that was used. And just believing in that is a major, major part of the advance that led to GPT3.