AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Future of Deep Learning
The talk is about the future of deep learning. And they start that conversation kind of going back to that scale ability thing that we talked about at the beginning of this, and that was, they specifically call out the language model gpt three. It has one red and 75 billion perameters. They point out that that's still tiny compared to the snaps is in t i human brain, but that it generates notably better text than gpt two. But their point is that you're getting better performance simply by scaling up in these areas. Also mention that current systems are not as robust to changes as humans are.