The Importance of Context in Chat GPT

Lance: The self attention thing, you can extract what's most important about an input sequence without having to pre program that. And so that lets let's essentially lets the model understand context well enough that sounds like human like because humans can understand. What I find interesting about what you said too is that people get frustrated with chat GPT sometimes when they don't give a good enough prompt and prompt engineering is a whole thing. Great point Lance.