Stability.ai's Emad Mostaque: "We're all going to die - but not from AI"
The Times Tech Podcast
00:00
The New Generation of Chips Allows You to Scale the Ability to Absorb and Understand Attention
In the previous generations of chips, what happened is that as you scaled up, because you could stack them, you suddenly got this attenuation. The more chips didn't give you better performance. And so what is this new generation of chips going to do? They've allowed you to scale the ability to absorb and understand that attention. There's 256 chips that drew 500 watts of electricity each. Just imagine 256 play stations. Because when you say chip, I think tiny, tiny chip. Yeah, now it's like the GPUs you see in these souped up computers with all the LED lights. That's a chip. So like a BCR size, I'm updating myself now.
Transcript
Play full episode
