AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Supper Club × OpenAI, Future of programming, LLMs, and Math with Andrey Mishchenko
Syntax - Tasty Web Development Treats
How RLHF Works
3min Snip
00:00
Summary
Transcript
Episode notes
The RLHF works by using two models. One is called a reward model, and one is the actual model you're trying to train. The base model will get used to generate conversations over and over again for the same initial prompt. And then human raiders will be asked, which of these do you prefer? And those ratings feed into the reward model. They like are used to train the rewardmodel. We could also use the thumbs up thumbs down in chat, in the UI. I'm not sure whether I'm allowed to talk about whether we do that or do that.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode