Gradient Dissent: Conversations on AI cover image

Advanced AI Accelerators and Processors with Andrew Feldman of Cerebras Systems

Gradient Dissent: Conversations on AI

CHAPTER

The Importance of Fine-Grained Control in GPUs

The GP uses a technique to overcome the weakness of limited memory bandwidth. It can do not just matrix by matrix, but matrix by vector or even scalar times vector a x plus y. And if you can have such fine-grained control, you never need to multiply by zero. You can block them out.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner