AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
4min chapter
Building LLM Apps & the Challenges that come with it. The What's AI Podcast Episode 16: Jay Alammar
What's AI Podcast by Louis-François Bouchard
How to Train a Language Model
I would love if you could go over the different steps from the self-supervised part to the fine tuning to the reinforcement learning with human feedback. Like how would you explain all those quite complicated steps in simple words? Yeah. So training works. One of the things that makes these models work now is that we can have a lot of data that is unlabeled and train the model. And so you can see that we can just slide this window and create millions or billions of training examples. This is why they're called language models. Now that turned out to be one of the most magical things, one of the biggest returns of investments that maybe the technology system was like if human technology
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode