DevOps and Docker Talk: Cloud Native Interviews and Tooling Is Docker Building the Best AI Stack?
Aug 12, 2025
This week, Michael Irwin from Docker's developer success team dives into the cutting-edge AI toolkit Docker offers. He discusses the impressive Model Runner for easy model deployment and the benefits of seamless integration with tools like the MCP Toolkit. Michael highlights the innovative Gordon AI chatbot in Docker Desktop and shares insights on optimizing workflows using Docker with AI. He also touches on cost-effectiveness in cloud computing and the burgeoning potential of open-source models, making a compelling case for Docker's role in the AI landscape.
AI Snips
Chapters
Transcript
Episode notes
Use Gordon AI For Docker Tasks
- Try Gordon AI inside Docker Desktop to speed Docker tasks and avoid switching to external chat tools.
- Use it to convert run commands to Compose files, troubleshoot containers, and save keystrokes daily.
Local Models Can Diverge From Production
- Models used locally can differ substantially from production hosted models, so outputs will vary with model size.
- Consistent model choice across development and production reduces surprising behavior and eases testing.
Google Search Appliance Analogy
- Bret likened early enterprise on-prem AI to Google's old search appliance story to show parallels in buying specialized hardware.
- He used that story to explain why enterprises may buy GPUs or use cloud-hosted models to protect internal data.