AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Instruction GPT Is Better at Attending to What You're Asking It to Do
In instruct GPT, it's much better at actually doing the task. And that's because instruct GPT is fine tuned to basically attend to what you're asking it to do more than like the thing itself,. But again, that's a worse simplification people are going to yell at me for but I don't care. One of the big open questions right now is like how do we evaluate how good these models actually are? We're kind of saturating all around benchmarks and then people come along and demonstrate some tasks they're absolutely horrible at which means that we've got bad evaluations right now.