Gradient Dissent: Conversations on AI cover image

Advanced AI Accelerators and Processors with Andrew Feldman of Cerebras Systems

Gradient Dissent: Conversations on AI

00:00

The Importance of Fine-Grained Control in GPUs

The GP uses a technique to overcome the weakness of limited memory bandwidth. It can do not just matrix by matrix, but matrix by vector or even scalar times vector a x plus y. And if you can have such fine-grained control, you never need to multiply by zero. You can block them out.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app