
Ep 11: Future of AI Computing and How to Build & Nurture Hardware Teams with Jim Keller, Tenstorrent
Computer Architecture Podcast
00:00
Is Size Always Better Than Cleverness?
AI is like the capabilities are changing really fast. There's a, there's a new benchmark every six months and they're hitting something called benchmark saturation. So architecture models and technology will move to the point where you don't need memory to store intermediate operations. Large memories for holding a trillion useful bits of information seems like a fine use for a large memory. Eight terabytes of bandwidth because you need to storage intermediate operations seems kind of crazy.
Play episode from 38:29
Transcript


