Computer Architecture Podcast cover image

Ep 11: Future of AI Computing and How to Build & Nurture Hardware Teams with Jim Keller, Tenstorrent

Computer Architecture Podcast

00:00

Is Size Always Better Than Cleverness?

AI is like the capabilities are changing really fast. There's a, there's a new benchmark every six months and they're hitting something called benchmark saturation. So architecture models and technology will move to the point where you don't need memory to store intermediate operations. Large memories for holding a trillion useful bits of information seems like a fine use for a large memory. Eight terabytes of bandwidth because you need to storage intermediate operations seems kind of crazy.

Play episode from 38:29
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app