AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Progress of the Language Model Foundation Model Space
Vivek, your paper builds off of a long line of work. I'd love for you to highlight maybe some of the methodological advances that have been recent that have made this paper possible. And also maybe you could reflect on where you see the frontier now and the most interesting line of work to extend this going forward. Vivek: The biggest innovation in deep learning and AI since probably the original image net results back in 2012. If you look under the hood the model is like super expressive in the forward pass.