Alex Tamkin on Self-Supervised Learning and Large Language Models
The Gradient: Perspectives on AI
00:00
The Paradigm Shift in Deep Learning
I feel like I've only been doing, you know, deep learning stuff for a relatively short amount of time and yet have already gone to witness several paradigm shifts. One in the LPC group when, when burnt came out or something like that. This is several hundred million parameters. That's a big model. Yeah, now that's just deployed. First it was millions of parameters. I'm gonna put hundreds of millions and now it's billions. There's thousands of millions. It's pretty interesting how much is happening in such a short period of time.
Transcript
Play full episode
