The Future of LLMs

Human performance on a task is not an upper bound on LLM performance. One of the reasons I think these systems can be better at a lot of tasks than humans is just that they've learned more stuff that they've read and mostly memorized. So you can sort of imagine what happens if you get someone who's not especially bright, but basically reasonably intelligent, reasonably competent person who's just gotten a PhD in every single thing you can get a PhD in. And probably they'll notice some things that would be really hard for even a team or an organization to do.