Lowering the Cost of Intelligence With NVIDIA's Ian Buck - Ep. 284
Ian Buck from NVIDIA explains how mixture-of-experts (MoE) architecture allows for smarter AI models without a proportional increase in compute and cost. He discusses the complexities of MoE models and the importance of co-design across compute, networking, and software.