The Quanta Podcast cover image

Tiny Language Models Come of Age

The Quanta Podcast

00:00

Exploring the Complexity of Language Prediction and Large Language Models

Exploring the challenges in predicting the next words based on grammar, factual knowledge, and logical reasoning, emphasizing the vast amount of data needed for meaningful linguistic capabilities. Introduction to the impressive GPT 3.5 model on its massive scale and the computational resources it demands.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app