CrowdScience cover image

Can Artificial Intelligence teach itself?

CrowdScience

00:00

The Pre-Training Stage of AI Language Models

Pablo Vielobos is a researcher who tries to understand progress in AI and machine learning. He explains how language models have to be trained so that they can learn in the first place. Even though it might seem like AI doesn't need humans at all, that couldn't be more wrong. The pre-training stage involves going through a lot of text and trying to make predictions based on that text.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app