The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Generative Benchmarking with Kelly Hong - #728
Kelly Hong of Chroma discusses Generative Benchmarking, a method for evaluating retrieval systems using synthetic data. The conversation covers the limitations of traditional benchmarks, the process of generating realistic queries, and the importance of domain-specific…