Is scaling all you need for AI Large Language Models? Scaling laws and the Inverse Scaling Challenge. Featuring Ian McKenzie, FAR AI Research Scientist
Orchestrate all the Things
00:00
Is There a Way to Make Language Models Better at Retracting Data?
It is a tricky one. Well I would argue that many people would actually also fall for it so it has to do with reasoning and so it may be a little bit too much too ask of a language model. It's possible that some of the recent approaches like reinforcement learning from human feedback will make language models better at this kind of task but I actually don't currently know what way how to approach this oneI think it's an interesting open question.
Transcript
Play full episode
