Run local LLMs easily with Docker's new Model Runner and MCP Toolkit. Unlock GPU acceleration and secure your AI development without cloud dependencies.
Big thanks to Docker for sponsoring this video. Try MCP Catalog for free: https://dockr.ly/4rptjx1
// David's SOCIAL //
Discord: https://discord.com/invite/usKSyzb
X: https://www.twitter.com/davidbombal
Instagram: https://www.instagram.com/davidbombal
LinkedIn: https://www.linkedin.com/in/davidbombal
Facebook: https://www.facebook.com/davidbombal.co
TikTok: http://tiktok.com/@davidbombal
YouTube: https://www.youtube.com/@davidbombal
Spotify: https://open.spotify.com/show/3f6k6gERfuriI96efWWLQQ
SoundCloud: https://soundcloud.com/davidbombal
Apple Podcast: https://podcasts.apple.com/us/podcast/david-bombal/id1466865532
// MY STUFF //
https://www.amazon.com/shop/davidbombal
// SPONSORS //
Interested in sponsoring my videos? Reach out to my team here: sponsors@davidbombal.com
// MENU //
0:00 - Coming up
0:37 - New tools released on Docker
04:38 - Docker Model Runner demo
07:41 - Docker Model GUI // How to pull and remove models
12:19 - Ask Gordon feature demo
14:24 - Quick MCP basic walkthrough
15:11 - MCP Toolkit demo // Claude Desktop and Claude Code
22:25 - Installing necessary software for AI model
25:45 - How to use LLMs overview
27:45 - Setting up the AI model in Docker Desktop
36:26 - MCP Toolkit catalog
39:25 - Claude Desktop demo
41:49 - Connecting GitHub to Docker Desktop
44:25 - End of demo
45:20 - David & Dawid channel // Conclusion
Please note that links listed may be affiliate links and provide me with a small percentage/kickback should you use them to purchase any of the items listed or recommended. Thank you for supporting me and this channel!
Disclaimer: This video is for educational purposes only.
#docker #localai #mcp