Education Bookcast cover image

147. Large language models (LLMs) - interview with Dr Guy Emerson

Education Bookcast

CHAPTER

The Future of Language Models

A lot of these large language models are trained on so much data that is just not plausible for a human to ever experience that much language in their whole lifetime. In ten years okay so now it's not even going to be a you know a billion maybe more like a hundred million tokens. So if I want to train a model on that amount of text and say well I should be able to say something interesting about the patterns that a learner could acquire on thatamount of data this is a very different kind of research question from what you can do when you have a hundred billion tokens of text.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner