The Relationship Between Inference and Sequence Models and Control

The relationship between sequence models and control is an extremely old one. And there's still more to be gained from that connection. I have been a bit surprised by some of the investigations into how language models act as a few shot learners. As they get bigger, some people say they take lost data to fine chin. Maybe they're doing some kind of few shot learning during trainings law.