Anton Teaches Packy AI | E1
"Age of Miracles"
Instruction GPT Is Better at Attending to What You're Asking It to Do
In instruct GPT, it's much better at actually doing the task. And that's because instruct GPT is fine tuned to basically attend to what you're asking it to do more than like the thing itself,. But again, that's a worse simplification people are going to yell at me for but I don't care. One of the big open questions right now is like how do we evaluate how good these models actually are? We're kind of saturating all around benchmarks and then people come along and demonstrate some tasks they're absolutely horrible at which means that we've got bad evaluations right now.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
