AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
AI Progress Compared to Expectations
The progress of AI, especially in language models like GPT-2 and GPT-3, has surpassed initial expectations, leading to a pivot in research focus towards language models. There was initial skepticism about the revolutionary potential of GPT-2, but after GPT-3, a shift in perspective occurred. The discussion also mentions a potential future shift towards post-training in AI models, highlighting the high-quality output generated by these models in comparison to existing content on the web.