DeepSeek's New LLM Architectures
In this episode, Pierce and Richard analyze DeepSeek's new LLM architectures: Manifold-Constrained Hyper Connections and Engram memory. They discuss the conceptual soundness and potential adoption of these architectures in US labs.