Software Engineering Radio - the podcast for professional software developers
SE Radio 703: Sahaj Garg on Low Latency AI
In this episode, Sahaj Garg, CTO of wispr.ai, joins SE Radio host Robert Blumen to discuss the challenges of building low-latency AI applications. They cover how to measure and scale latency, its effect on consumer behavior, and techniques for managing latency in AI, including…