AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Stability.ai's Emad Mostaque: "We're all going to die - but not from AI"
The Times Tech Podcast
The New Generation of Chips Allows You to Scale the Ability to Absorb and Understand Attention
2min Snip
00:00
Summary
Transcript
Episode notes
In the previous generations of chips, what happened is that as you scaled up, because you could stack them, you suddenly got this attenuation. The more chips didn't give you better performance. And so what is this new generation of chips going to do? They've allowed you to scale the ability to absorb and understand that attention. There's 256 chips that drew 500 watts of electricity each. Just imagine 256 play stations. Because when you say chip, I think tiny, tiny chip. Yeah, now it's like the GPUs you see in these souped up computers with all the LED lights. That's a chip. So like a BCR size, I'm updating myself now.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode