The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Is It Time to Rethink LLM Pre-Training? with Aditi Raghunathan - #747
Aditi Raghunathan joins the TWIML AI Podcast to discuss limitations in current LLM pre-training, exploring concepts like "Roll the dice & look before you leap" for more creative outputs. The episode also covers "catastrophic overtraining" and methods for building more reliable…