The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Scaling Agentic Inference Across Heterogeneous Compute with Zain Asgar - #757
Zain Asgar joins TWIML AI to discuss Gimlet Labs’ strategy for scaling agentic inference across heterogeneous compute. The discussion covers Gimlet’s approach to disaggregating workloads across various hardware, optimizing unit economics, and their novel system for autonomous…