I was interested in capabilities that were just on the fringe of reliability that nobody had really thought to chase yet. And after enough tuning on these examples, it somehow generalized that it got better at following instructions of a previously unseen length. I could tell that those were the sort of the prompts worth considering now because models are going to improve. RLHF marches onward: These models become more capable and more able to follow more complicated directions reliably.
This is a special preview episode of The Cognitive Revolution: How AI Changes Everything. Hosted by Erik Torenberg and Nathan Labenz, TCR hosts in-depth interviews with the creators, builders and thinkers pushing the bleeding edge of AI. On this episode, they talk with Riley Goodside, the first Staff Prompt Engineer at Scale AI and expert in prompting LLMs and integrating them into AI applications.
Check out The Cognitive Revolution The perfect AI interview complement to The AI Breakdown https://link.chtbl.com/TheCognitiveRevolution Find TCR on YouTube: https://www.youtube.com/@CognitiveRevolutionPodcast