How to Fine Tune a Text Model

3min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

When you have a pre-trained model that just completes text, you have to do those sort of imaginative things. Because if you don't do these things, there is a lot of like not useful ways to complete documents. If you give it instructions, it won't follow the instructions. It will just continue writing more instructions. So in order to prevent this unintuitive behavior, they fine tune the model.

This is a special preview episode of The Cognitive Revolution: How AI Changes Everything. Hosted by Erik Torenberg and Nathan Labenz, TCR hosts in-depth interviews with the creators, builders and thinkers pushing the bleeding edge of AI. On this episode, they talk with Riley Goodside, the first Staff Prompt Engineer at Scale AI and expert in prompting LLMs and integrating them into AI applications. Check out The Cognitive Revolution The perfect AI interview complement to The AI Breakdown https://link.chtbl.com/TheCognitiveRevolution Find TCR on YouTube: https://www.youtube.com/@CognitiveRevolutionPodcast