AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
What Surprised You the Most About Large Language Models
Iliya: Can you describe the technology in simple terms. And now that you're at the forefront of the tech, can you share what it surprised you the most about what the tech can do? Iliya: The explanation for why it works is both simple and extremely beautiful. We train a big neural network to guess the next word from the previous words in text. Being able to guess what comes next very, very accurately requires prediction,. It's hard to come up with a clean answer, but it is easy to measure and optimize the prediction error.