GPT three has no idea what letters look like. It would just get like make up this like weird geometric description. And for many letters, it would give very similar answers that it would all be described as sort of variations of like a box that contains an X. This is one of the first times that people started to see like that there's drawbacks to RLA-TF or to instruction tuning at this point.
This is a special preview episode of The Cognitive Revolution: How AI Changes Everything. Hosted by Erik Torenberg and Nathan Labenz, TCR hosts in-depth interviews with the creators, builders and thinkers pushing the bleeding edge of AI. On this episode, they talk with Riley Goodside, the first Staff Prompt Engineer at Scale AI and expert in prompting LLMs and integrating them into AI applications.
Check out The Cognitive Revolution The perfect AI interview complement to The AI Breakdown https://link.chtbl.com/TheCognitiveRevolution Find TCR on YouTube: https://www.youtube.com/@CognitiveRevolutionPodcast