Is Docker Building the Best AI Stack?

Bret and Nirmal are joined by Michael Irwin to discuss Docker's comprehensive AI toolkit, covering everything from local model deployment to cloud-based container orchestration across multiple interconnected tools and services. 🙌 The Agentic DevOps Guild has launched! It's a training + community + mentorship program for engineers wanting to learn the latest CI/CD automation and dive into Agentic DevOps. Meetups are happening now, with new course videos dropping every few weeks. Join the Guild and become your team's leader in AI for infrastructure automation https://www.bretfisher.com/theguild 🍾 We run through almost the entire Docker AI ecosystem, including the Model Runner for hosting open-source models locally or remotely, the Hub model catalog, Gordon AI chatbot integration within Docker Desktop and CLI, how MCP toolkit and catalog enable seamless tool integration with local AI systems, Docker's open-source MCP gateway for managing these connections, plus Docker's new Offload service for running containers and models entirely in Docker Cloud and much, much more! ★Show Links★ Docker Model Runner Gordon AI Blog Post Docker Offload Docker Gen AI Catalog Docker MCP Catalog and Toolkit Docker MCP Gateway Repository Check out the video podcast version here: https://youtu.be/dUmSsnc33O0 Creators & Guests Cristi Cotovan - Editor Bret Fisher - Host Beth Fisher - Producer Nirmal Mehta - Host Michael Irwin 🇺🇦 🕊 - Guest You can also support this podcast by subscribing to my YouTube channel and my weekly newsletter at bret.news ! Grab the best coupons for my Docker and Kubernetes courses . Join my cloud native DevOps community on Discord . Grab some merch at Bret's Loot Box Homepage bretfisher.com (00:00) - Intro (04:32) - Gordon AI (11:58) - Docker Model Runner (21:51) - State of Free Models (24:28) - MCP Toolkit (26:56) - MCP Gateway (36:02) - MCP Server Limits (40:48) - MCP Gateway vs API Gateway (48:28) - Model Support in Docker Compose (53:17) - Docker Offload

Listen