Ian Buck

Ian Buck, NVIDIA's VP of Hyperscale and High-Performance Computing, dives into the fascinating world of mixture-of-experts (MoE) architecture. He explains how MoE allows smarter AI models to operate with reduced compute costs by activating only necessary components. Buck highlights the importance of NVLink for maximizing performance and discusses the trade-offs between using MoE versus smaller models. Moreover, he envisions MoE's potential across various domains beyond just language, making a compelling case for its future impact.