AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
2min chapter
ChatGPT and InstructGPT: Aligning Language Models to Human Intention
Deep Papers
Do You See Other Major Applications Just Skipping the First Step?
RLHF helps you get more fine-grained tuning of model behavior, whereas supervised fine-tuning collecting demonstrations can kind of more drastically shift the model behavior. For instance, let's say you have some model that just like to start off with it sucks at generating summaries and so getting a bunch of ranking feedback between different really shitty summaries is maybe not the most useful. Instead, what you might want to do is collect some examples of really, really good summaries and then have your model kind of try to imitate that for a bit. And we have some results on this in a different paper, but it's still a very open question actually.
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode