AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Next Paradigm for Generative Models
Next token prediction can only help us match human performance, and maybe not surpass it. What would it take to surpass human performance? So I challenge the claim that next token prediction cannot surpass human performance. If your base neural net is smart enough, you just ask it like, what would a person with great insight and wisdom and capability do? Maybe such a person doesn't exist, but there's a pretty good chance that the neural net will be able to extrapolate how such a person could behave.