Home » Youtube

Youtube

In this video I walk you step-by-step through installing and using Google Gemini CLI on Windows, Linux and macOS. Watch me translate Bash to PowerShell, refactor Terraform on the fly, and auto-generate Conventional Commit messages—all without leaving the shell. If you love productivity hacks for your home lab, dev workstation, or sysadmin toolkit, this demo is for you. 🛠️ Want an affordable box to test Gemini CLI on every OS? I’m using the GEEKOM A5 2025 Mini PC → https://geni.us/geekoma52025-3 🔑 What I Cover • Why Gemini CLI is a game-changer no matter which OS you use • Fast installation with Node.js + npm (I showcase Winget on Windows) • First-run login, theme setup, and authentication with Google • Live demos: code conversion, IaC explanations, Git commit magic & more • My pro tips: one-letter aliases, clipboard piping, fuzzy-find + AI workflows 📝 Dive Deeper on the Blog • Full guide: Install Google Gemini CLI and Supercharge Your Terminal → https://www.virtualizationhowto.com/2025/06/install-google-gemini-cli • kubectl-ai: Bring Generative AI to Kubernetes Management → https://www.virtualizationhowto.com/2025/05/meet-kubectl-ai • Host Your Own GPT in a Home Lab: Updated Guide for 2025 → https://www.virtualizationhowto.com/2025/07/host-your-own-gpt 🤝 Connect with Me 🌐 Blog – https://www.virtualizationhowto.com 📧 Newsletter – Daily Tech Deals & Lab Tips: https://www.virtualizationhowto.com/subscribe 📰 Substack – Between the Clouds newsletter: https://bleevht.substack.com 🎓 Skool Community – Home Lab Explorers: https://www.skool.com/homelabexplorers 🐦 X / Twitter – @VirtHowTo 💼 LinkedIn – linkedin.com/in/brandonlee-it 📢 Join the Conversation Got a killer Gemini CLI prompt or workflow? Drop it in the comments so we can all level up! 👍 Like the video if it helps, Subscribe for more virtualization and home-lab how-tos, and ring the bell so you never miss an update. Some links may be affiliate links; they cost you nothing and help support the channel—thanks! Introduction to Gemini CLI - 0:00 Talking about Gemini CLI and what it is - 0:29 It is shell agnostic - 1:12 Piping staged git diff and having it craft the git commit message - 1:40 NodJS is required to run it, speaking of the installation options - 2:29 Using winget to install NodeJS in Windows - 2:57 Talking through the install of Gemini CLI - 3:25 Need to reopen your terminal session after NodeJS install - 3:45 After talking about and walking through the initial setup - 4:13 Setting the interface defaults and color scheme - 4:47 Authentication methods - 5:00 Google login prompt - 5:29 Message from Google that Gemini CLI is now authorized - 5:50 Practical tasks that work across OS's - 6:11 Using set alias for the prompts so it is easier - 6:43 Workflows and tasks for Gemini CLI - 7:19 Gemini starts the context from the folder where you are focused - 8:00 Counting files in a folder - 8:16 Asking it if it is a git repository folder - 8:29 Using it for security scanning and posturing - 8:51 Viewing the number of tokens you have used when you exit - 10:25 Having it tell us what terraform code does exactly - 10:49 Running prompts from the command line non-interactively - 12:31 Wrapping up and thoughts on where AI is headed - 13:22 Subscribe and hit the bell! 13:53 Join the HomeLabExplorers Skool community! 14:16
Google Gemini CLI: AI in Your Terminal (Windows • Linux • macOS)
Ready to cram 11 drives, dual 10 GbE + 2.5 GbE, and an 8-core Zen 4 CPU into the tiniest footprint on your rack? In this review we unpack and stress-test the Aoostar WTR Max to see if it deserves a spot in your 2025 home-lab stack running Proxmox, TrueNAS, Docker, or even VMware ESXi. Buy the Aoostar WTR Max here: https://aoostar.com/products/aoostar-wtr-max-amd-r7-pro-8845hs-11-bays-mini-pc?variant=50067345932586 🔗 Full Blog Review (photos, charts & power logs): 👉https://www.virtualizationhowto.com/2025/06/aoostar-wtr-max-review-the-almost-perfect-nas-mini-pc/ 💡 Related Gear Mentioned • Geekom A5 2025 Edition mini-PC (great low-power companion node) – Geniuslink: 👉https://geni.us/geekoma52025-3 Join the Home Lab Explorers Community (free on Skool) 👉 https://www.skool.com/homelabexplorers/about?ref=25f64c297b724689ae81c7dd30ba2c21 Introduction - 0:00 Overview of the Aoostar WTR Max - 0:25 No NAS operating system - 1:40 All Intel-based NICs - 2:00 Ryzen 7 8845HS processor - 2:17 ECC DDR5 Memory support - 2:47 Connectivity potential - 3:00 OCuLink - 3:30 Looking at getting into the bottom chassis - 3:44 Talking about Proxmox installation - 5:09 Power and Thermals - 5:25 Full power draw - 5:46 Fan cage and cooling potential - 6:00 Showing how to remove the fan tray - 6:15 OS compatibility - 7:02 Pros of the Aoostar WTR Max - 7:45 Cons of the Aoostar WTR Max - 8:19 Talking about tradeoffs and how it makes up for those - 8:47 Should you buy it? 9:05 What do you think and wrapping up - 9:30 HomeLabExplorers! 10:02
11-Drive Mini Monster NAS! Aoostar WTR Max Review
🎙️ Episode 2 – BetweenTheClouds 🛠️ Featured Tools & Projects VMware Cloud Foundation 9.0 Explore major upgrades like NVMe Memory Tiering, GPU vMotion, vSAN ESA global deduplication, enhanced multi-tenancy, and full-stack lifecycle improvements. CoreControl A beautifully designed, self-hosted dashboard for your home lab. Track CPU, memory, disk, network usage, and container services in real time—all in a lightweight Docker container. 🔗 Read the full post (https://www.virtualizationhowto.com/2025/06/corecontrol-is-the-new-self-hosted-dashboard-built-for-home-labs/) Docker Rollout Safely roll out container updates with health checks, staged deployments, and automatic rollback. Ideal for Swarm or Compose workflows. ProxMenux The command-line Proxmox tool you didn’t know you needed. Manage VMs, LXCs, storage, passthrough, backups, and even network configs from a clean menu-based UI. 🔗 Learn more (https://www.virtualizationhowto.com/2025/05/proxmenux-might-be-the-best-proxmox-management-tool-youre-not-using/) 🛠️ GitHub Repo (https://github.com/MacRimi/ProxMenux) OmniTools A Swiss Army knife of privacy-respecting web utilities—run entirely in your browser, locally. Convert JSON/YAML/CSV, edit PDFs, manipulate images, and more. 🔗 Full review (https://www.virtualizationhowto.com/2025/06/omnitools-a-swiss-army-knife-of-self-hosted-utilities/) 🛠️ GitHub Repo (https://github.com/iib0011/omni-tools) 📚 Resource Links Name URL VirtualizationHowto Blog https://www.virtualizationhowto.com YouTube Channel https://www.youtube.com/@VirtualizationHowto Substack Newsletter https://bleevht.substack.com HomeLabExplorers! HomeLabExplorers (https://www.skool.com/homelabexplorers/about?ref=25f64c297b724689ae81c7dd30ba2c21)   🔮 Coming Up Next In Episode 3, we will talk about more Home lab tools, news, and other notables around the tech world! If you enjoyed this episode, hit subscribe, leave a review, and share it with your homelab or DevOps crew. Thanks for tuning in to BetweenTheClouds—until next time, keep building and I’ll catch you… between the clouds. ☁️
Episode 2: VCF 9, CoreControl, Docker Rollout, and ProxMenux for Proxmox in Your Home Lab
If you’re running Proxmox in your home lab or production setup, there’s a hidden gem of a tool you need to know about: ProxMenux. In this video, I walk you through what ProxMenux is, how it works, and why it might just become your favorite tool for managing your Proxmox VE servers. Topics Covered: What is ProxMenux? Key features and capabilities How to install ProxMenux on your Proxmox VE server Full breakdown of every menu and option Why this tool is ideal for home lab admins and Proxmox newcomers 👉 Read the full blog post with screenshots and install instructions: https://www.virtualizationhowto.com/2025/05/proxmenux-might-be-the-best-proxmox-management-tool-youre-not-using/ 🖥️ Running Proxmox on a Mini PC? Check out the Geekom A5 2025 edition — a powerful mini PC I recommend for home lab use. 🔗 Grab it here via Geniuslink: https://geni.us/geekoma52025-3 📌 ProxMenux GitHub repo: https://github.com/MacRimi/ProxMenux 💬 Let me know in the comments if you’re using ProxMenux or plan to try it out! HomeLabExplorers!!! https://www.skool.com/homelabexplorers/about?ref=25f64c297b724689ae81c7dd30ba2c21 ★ Substack URL: bleevht.substack.com ★ Subscribe to the channel: https://www.youtube.com/channel/UCrxcWtpd1IGHG9RbD_9380A?sub_confirmation=1 ★ My blog: https://www.virtualizationhowto.com ★ Twitter: https://twitter.com/vspinmaster ★ LinkedIn: https://www.linkedin.com/in/brandon-lee-vht/ ★ Github: https://github.com/brandonleegit ★ Facebook: https://www.facebook.com/people/VirtualizationHowto/100092747277326/ ★ Discord: https://discord.gg/Zb46NV6mB3 ★ Pinterest: https://www.pinterest.com/brandonleevht/ Introduction to Proxmenux - 0:00 What is ProxmenuX? 0:49 Things you can do with it - 1:44 Why you might want to use ProxmenuX - 2:26 Looking at the installation process - 3:12 After launch and looking at the menu - 5:31 Walking through all of the ProxmenuX menus - 6:01 Talking about provisioning appliances using ProxmenuX - 12:57 Walkthrough of using Proxmenux to create a NAS VM from template - 13:31 Wrapping up using ProxmenuX - 17:08 Drawing for the Geekom A5 2025 Mini PC! 17:43 Subscribe! 18:08
Best Proxmox Tool You are Not Using Yet - Proxmenux!
🎙️ Introducing Between the Clouds: A Podcast for the Home Lab and Hybrid Cloud Era What does it really mean to live “between the clouds”? For many of us in IT whether you're a home lab enthusiast, systems architect, or cloud-native developer it means operating at the intersection of private infrastructure and public cloud services. And that’s exactly the space this new podcast is here to explore. Today, I’m excited to launch the very first episode of Between the Clouds, a weekly show where we build, break, and learn in real-time. I’m Brandon Lee, the creator behind VirtualizationHowto.com (https://www.virtualizationhowto.com/) , longtime home labber, VMware vExpert, DevOps engineer, and someone who’s spent years getting hands-on with everything from Proxmox clusters to LLMs running on mini PCs, Kubernetes clusters, and serverless functions in AWS. This podcast is a natural extension of the work I’ve been doing across my blog, YouTube channel, and home lab. Only now, we’re diving deeper, more conversationally, and with plenty of room to explore the tools and trends that are reshaping how we run infrastructure in 2025. What You’ll Hear in Episode One In this pilot episode, I cover: * Running local AI on ancient GPUs: Can a 10-year-old GTX 1060 still handle modern LLMs like Mistral 7B and Gemma 2B? You might be surprised—because I was. * PCI passthrough with Proxmox: I walk through passing a GPU to both VMs and LXC containers to run Ollama + Open WebUI in the home lab. * NetAlertX: A fork of PyAlert that offers real-time network monitoring, Home Assistant integration, and modern notification options. * DevOps Career Tips: I break down 10+ practical steps for transitioning from traditional IT roles into DevOps—including building a home lab, learning Git, using AI as a tutor, and getting hands-on with Docker, Kubernetes, Terraform, and more. I also share two of my all-time favorite DevOps reads: The Phoenix Project and The DevOps Handbook—which, if you haven’t read yet, should absolutely be on your radar. Why This Podcast? Most people in this space don’t live fully in the cloud—or fully on-prem. We’re building and learning in a hybrid world where Kubernetes clusters run in garages and homegrown CI/CD pipelines push code to real cloud environments. That’s where Between the Clouds lives: in the tension, the experimentation, and the stories of what actually works (and what doesn’t). Each episode will be a blend of: * Tech walkthroughs and tools I’m using now * Commentary on trends in virtualization, cloud, and security * Community highlights and insights from the field * Real-world lessons from failed experiments and surprising wins * Interviews of industry professionals Whether you're spinning up VMs on a $400 mini PC, running Ollama with GPU passthrough, or diving into CI/CD pipelines and Terraform code, this podcast is for you. 🎧 Listen Now If this sounds like your kind of content, hit Subscribe so you don’t miss future episodes and consider becoming a paid subscriber for premium content and podcasts. And if you enjoy it, please consider sharing and restacking with a fellow home labber, cloud tinkerer, or DevOps hopeful. Let’s build something great—between the clouds. —Brandon Get full access to Between the Clouds Newsletter at bleevht.substack.com/subscribe (https://bleevht.substack.com/subscribe?utm_medium=podcast&utm_campaign=CTA_4)
Kicking Off Between the Clouds: AI on Old GPUs, NetAlertX, and DevOps Mindset
Giving away this low power Proxmos mini pc to a commenter! #homepc #minipc #pcenthusiasts #homelab
Looking for the ultimate low-power mini PC for your Proxmox home lab in 2025? In this video, we review the Geekom A5 2025 Edition. It is a compact and energy-efficient mini PC that’s perfect for running Proxmox VE, Docker containers, or even Kubernetes nodes. With an AMD Ryzen 5 7430U, support for up to 64 GB of RAM, dual storage options, and ultra-low power draw (just 4W idle!), this might be the best Proxmox box for 24/7 workloads. Watch the full review to see power usage, upgrade tips, and real-world use cases. 📦 Check it out here (affiliate link): https://geni.us/geekoma52025-3 Official US: https://www.geekompc.com/geekom-a5-2025-edition-mini-pc/ Official CA:https://www.geekom.ca/geekom-a5-mini-pc/ • 5% Coupon: A5VH2025 Written review of the Geekom A5 2025 Edition: https://www.virtualizationhowto.com/2025/06/best-low-power-mini-pc-for-proxmox-geekom-a5-2025-edition-review/ Subscribe on substack: bleevht.substack.com 🚀 Join the vibrant Home Lab Explorers Community 🔗 https://www.skool.com/homelabexplorers/about?ref=25f64c297b724689ae81c7dd30ba2c21 📺 Follow VirtualizationHowto Everywhere ⭐ Subscribe on YouTube → Click to Subscribe 📝 Read the Blog → https://www.virtualizationhowto.com 🌐 Connect with Me 🐦 Twitter → https://twitter.com/vspinmaster 💼 LinkedIn → https://www.linkedin.com/in/brandon-lee-vht/ 📦 GitHub → https://github.com/brandonleegit 📘 Facebook → https://www.facebook.com/people/VirtualizationHowto/100092747277326/ 💬 Discord → https://discord.gg/Zb46NV6mB3 📌 Pinterest → https://www.pinterest.com/brandonleevht/ Introduction - 0:00
Low Power Proxmox Home Server! Geekom A5 2025 Edition
🛒 Buy the Beelink ME Mini NAS: Amazon – https://geni.us/beelinkmemininas Official Beelink Store – https://www.bee-link.com/products/beelink-me-mini-n150 In this video, we take a deep dive into the Beelink ME Mini NAS—a tiny but powerful NAS device that fits in the palm of your hand. Although it is super small, it delivers serious performance and flexibility for home labs, media servers, and compact virtualization setups. 🧠 We’ll explore: Hardware specs, including the Intel N150 CPU & 12GB LPDDR5 RAM 6x NVMe M.2 slots with up to 24TB of flash storage Network connectivity with dual 2.5GbE ports Real-world use cases for TrueNAS, Proxmox, and more PCIe lane limitations and network bottleneck insights Power consumption metrics for 24/7 home lab use 📦 Whether you're a home labber, content creator, or just looking for a quiet and energy-efficient NAS, this little box might be exactly what you need! 📚 Related blog post: https://www.virtualizationhowto.com/2025/05/beelink-me-mini-nas-review-ultra-compact-storage-with-24tb-potential/ 👍 Like the video if you enjoy this kind of content and subscribe for more home lab reviews, tutorials, and virtualization tips! 🧠 Need Help or Have Questions? Join the VHT Community Forums → https://www.virtualizationhowto.com/community/ 🚀 Explore More with the Home Lab Explorers Community 🔗 https://www.skool.com/homelabexplorers/about?ref=25f64c297b724689ae81c7dd30ba2c21 📺 Follow VirtualizationHowto Everywhere ⭐ Subscribe on YouTube → Click to Subscribe 📝 Read the Blog → https://www.virtualizationhowto.com 🌐 Connect with Me 🐦 Twitter → https://twitter.com/vspinmaster 💼 LinkedIn → https://www.linkedin.com/in/brandon-lee-vht/ 📦 GitHub → https://github.com/brandonleegit 📘 Facebook → https://www.facebook.com/people/VirtualizationHowto/100092747277326/ 💬 Discord → https://discord.gg/Zb46NV6mB3 📌 Pinterest → https://www.pinterest.com/brandonleevht/ Introduction - 0:00 Size of the Beelink ME Mini - 0:50 Intel N150 - 1:20 Memory - 1:58 Storage - 2:36 Operating systems - 3:11 Onboard storage - 3:16 Network - 3:32 Active cooling and thermals - 4:18 Getting inside the unit - 4:46 Supported hypervisors and NAS OS's - 5:15 VMware ESXi is supported due to Intel networking - 5:43 Installing TrueNAS - 6:11 Discussing the PCIe lanes available in this NAS - 7:29 The bottleneck? 8:18 Use cases for this NAS - 8:48 Power efficiency - 9:18 Wrapping up my thoughts on the Beelink ME Mini - 9:52 #BeelinkME #HomeLab #NAS #Proxmox #TrueNAS #MiniPC #Virtualization #Storage #BrandonLee #VirtualizationHowto
This Tiny NAS Packs 24TB! Beelink ME Mini NAS Review for Home Labs
Google just added AI to Kubernetes! #kubernetes #homelab
🎯 Today’s Best Tech Deals 💻 Newegg Home Lab Picks → https://geni.us/vhtneweggdeals 🛒 Amazon Home Lab Deals → https://geni.us/FBtu Written blog post on kubectl-ai: https://www.virtualizationhowto.com/2025/05/meet-kubectl-ai-google-just-delivered-the-best-tool-for-kubernetes-management/ 🧠 Need Help or Have Questions? Join the VHT Community Forums → https://www.virtualizationhowto.com/community/ 🚀 Explore More with the Home Lab Explorers Community 🔗 https://www.skool.com/homelabexplorers/about?ref=25f64c297b724689ae81c7dd30ba2c21 📺 Follow VirtualizationHowto Everywhere ⭐ Subscribe on YouTube → Click to Subscribe 📝 Read the Blog → https://www.virtualizationhowto.com 🌐 Connect with Me 🐦 Twitter → https://twitter.com/vspinmaster 💼 LinkedIn → https://www.linkedin.com/in/brandon-lee-vht/ 📦 GitHub → https://github.com/brandonleegit 📘 Facebook → https://www.facebook.com/people/VirtualizationHowto/100092747277326/ 💬 Discord → https://discord.gg/Zb46NV6mB3 📌 Pinterest → https://www.pinterest.com/brandonleevht/ Proxmox Builds! BD795M: Minisforum BD795M – https://geni.us/bd795m RackChoice 2U Micro ATX Compact – https://geni.us/rackchoice2u Cooler Master MWE Gold 850 V2 – https://geni.us/coolermaster850 Crucial 128 GB 5600MT/sec RAM – https://geni.us/crucial128gbramkit Noctua NH-L9i-17xx, Premium Low-Profile CPU Cooler – https://amzn.to/4hAKIwG Crucial 96GB kit of DDR5 SODIMM memory kit – https://geni.us/noctuanhl9i17xx Intel X520-DA2 10 GbE network adapter – https://geni.us/intelx520 Kingston 240 GB drive for boot – https://geni.us/kingston240 Samsung EVO 990 Pro 2TB – https://geni.us/samsung990pro2tb MX-4 Thermal paste – https://geni.us/mx4thermalpaste Case fans: https://geni.us/arcticp8 BD795i SE: Minisforum BD795i SE mini-ITX motherboard – https://geni.us/minisforumbd795ise RackChoice 2U Micro ATX Compact Rackmount – https://geni.us/rackchoice2u Coolermaster MWE Gold 850 – https://geni.us/coolermaster850 Crucial 128 GB 5600MT/sec RAM – https://geni.us/crucial128gbramkit Kingston 240 GB drive for boot – https://geni.us/kingston240 Intel X520-DA2 10 GbE network adapter – https://geni.us/intelx520 Samsung EVO 990 Pro 2TB – https://geni.us/samsung990pro2tb Artic P12 slim fan – https://geni.us/arcticp8 BD790i X3D: Thermaltake Tower 200: https://geni.us/thermaltaketower200 Minisforum BD790i X3D: https://geni.us/minisforumbd790ix3d Cooler Master MWE Gold 850 V2 – https://geni.us/coolermaster850 Crucial 128 GB 5600MT/sec RAM – https://geni.us/crucial128gbramkit Artic P12 slim fan – https://geni.us/arcticp8 https://geni.us/asusgeforcertx5070 Predator 1TB boot drive: https://geni.us/predatorssd1tb Samsung 990 Pro 4TB VM storage: https://geni.us/samsungpro9904tb Introduction - 0:00 Overview of kubectl-ai - 1:46 Can use multiple models or local LLMs - 2:49 Will be a great learning tool - 4:02 Overview of installation, API key, and running commands - 4:28 Installing kubectl-ai - 5:29 Setting the API key - 6:56 Pointing it to a local LLM running on Ollama - 11:34 Setting up an alias to run the command and make it persistent - 13:10 How to test kubectl-ai - 17:10 Security of kubectl-ai - 21:21 Setting up Ollama for Private AI - 22:00
kubectl-ai Best AI Tool for Kubernetes?
Private AI With Ollama and OpenWebUI to host your own GPT models #oai #privateai #ollama #ai
Low Power server for home! #techtok #tech #minipc #gmktec #homelab
Building your own Private AI server is one of the most fun and exciting projects you can try out in your home lab environment. It is also a great way to learn more about AI, LLM models, and GPU passthrough configuration. Self-hosting and configuring your own AI environment is not as difficult as it might sound. Let's take a look at Proxmox, Ollama, and OpenWebUI, as well as Docker Desktop, GPU passthrough a my best practices and tips and tricks. I also show you what projects I am using Private AI servers for. Check it out! GPU passthrough to LXC containers in Proxmox: https://www.virtualizationhowto.com/2025/05/how-to-enable-gpu-passthrough-to-lxc-containers-in-proxmox/ Run Ollama with NVIDIA GPU in Proxmox VMs and LXC containers: https://www.virtualizationhowto.com/2025/05/run-ollama-with-nvidia-gpu-in-proxmox-vms-and-lxc-containers/ My 2025 Proxmox Build (affiliate links) Minisforum BD795M – https://geni.us/bd795m RackChoice 2U Micro ATX Compact – https://geni.us/rackchoice2u Cooler Master MWE Gold 850 V2 – https://geni.us/coolermaster850 Crucial 128 GB 5600MT/sec RAM – https://geni.us/crucial128gbramkit Noctua NH-L9i-17xx, Premium Low-Profile CPU Cooler – https://amzn.to/4hAKIwG Crucial 96GB kit of DDR5 SODIMM memory kit – https://geni.us/noctuanhl9i17xx Intel X520-DA2 10 GbE network adapter – https://geni.us/intelx520 Kingston 240 GB drive for boot – https://geni.us/kingston240 Samsung EVO 990 Pro 2TB – https://geni.us/samsung990pro2tb MX-4 Thermal paste – https://geni.us/mx4thermalpaste Case fans: https://geni.us/arcticp8 Check out the VHT forums to get your questions answered: https://www.virtualizationhowto.com/community/ Join the coolest home lab community here! https://www.skool.com/homelabexplorers/about?ref=25f64c297b724689ae81c7dd30ba2c21 ★ Subscribe to the channel: https://www.youtube.com/channel/UCrxcWtpd1IGHG9RbD_9380A?sub_confirmation=1 ★ My blog: https://www.virtualizationhowto.com ★ Twitter: https://twitter.com/vspinmaster ★ LinkedIn: https://www.linkedin.com/in/brandon-lee-vht/ ★ Github: https://github.com/brandonleegit ★ Facebook: https://www.facebook.com/people/VirtualizationHowto/100092747277326/ ★ Discord: https://discord.gg/Zb46NV6mB3 ★ Pinterest: https://www.pinterest.com/brandonleevht/ Introduction to Private AI in the home lab - 0:00 Why self-host GPT for private AI - 0:54 Prerequisites to running private AI at home - 1:27 Can you run this on something old? 1:55 Docker to play around with AI - 2:12 Ollama overview and what it does - 2:33 OpenWebUI chatGPT style interface to interact with Ollama - 2:44 Using Docker and overview of the setup - 3:06 Docker run or Compose can be used - 3:49 Looking at Docker Desktop - 4:11 Command to spin up ollama in Docker Desktop - 4:36 Spinning the OpenWebUI container from the docker command line - 5:55 Overview of what happens after we spin up both containers - 7:06 Showing how to browse out to the OpenWebUI - 7:40 First steps and adding models to your Ollama instance - 7:47 Talking about better performance with LLMs with GPUs - 8:17 Enabling the NVIDIA container toolkit and when needed - 8:43 Overview of GPU passthrough with Proxmox - 9:00 Options for running GPU passthrough in Proxmox (LXC containers, and Virtual Machines) - 10:00 Steps for GPU passthrough overview - 10:50 IOMMU requirement - 11:05 Checking IOMMU - 11:20 Grepping for the device - 11:56 Claiming the IDs for GPU passthrough in Proxmox - 12:53 Blacklisting the drivers for the host - 13:02 Seeing the RTX video card recognized in the VM running in Proxmox - 13:29 Adding a PCI Device in your virtual machine - 13:51 Passthrough challenges in Proxmox - 15:00 Performance of GPU - 15:41 Quick tips and best practices of using this in the home lab - 16:20 Wrapping up self-hosting private AI in your home - 17:00
Host a Private AI Server at Home with Proxmox Ollama and OpenWebUI
My Top AMD Ryzen Proxmox Builds for Home Lab #techtok #microserver #homelab #homeserver
I take you a comparison of three Proxmox builds based on Minisforum motherboards I have built in the past few months, the BD790i X3D, the BD795i SE, and the BD795M. All of these builds have their strengths and weaknesses, but overall I give you my thoughts on the overall winner I think in terms of features and capabilities offered by these boards. Build of materials for all three builds (these are Amazon affiliate links that I earn a small commission on) BD795M: Minisforum BD795M – https://geni.us/bd795m RackChoice 2U Micro ATX Compact – https://geni.us/rackchoice2u Cooler Master MWE Gold 850 V2 – https://geni.us/coolermaster850 Crucial 128 GB 5600MT/sec RAM – https://geni.us/crucial128gbramkit Noctua NH-L9i-17xx, Premium Low-Profile CPU Cooler – https://amzn.to/4hAKIwG Crucial 96GB kit of DDR5 SODIMM memory kit – https://geni.us/noctuanhl9i17xx Intel X520-DA2 10 GbE network adapter – https://geni.us/intelx520 Kingston 240 GB drive for boot – https://geni.us/kingston240 Samsung EVO 990 Pro 2TB – https://geni.us/samsung990pro2tb MX-4 Thermal paste – https://geni.us/mx4thermalpaste Case fans: https://geni.us/arcticp8 BD795i SE: Minisforum BD795i SE mini-ITX motherboard – https://geni.us/minisforumbd795ise RackChoice 2U Micro ATX Compact Rackmount – https://geni.us/rackchoice2u Coolermaster MWE Gold 850 – https://geni.us/coolermaster850 Crucial 128 GB 5600MT/sec RAM – https://geni.us/crucial128gbramkit Kingston 240 GB drive for boot – https://geni.us/kingston240 Intel X520-DA2 10 GbE network adapter – https://geni.us/intelx520 Samsung EVO 990 Pro 2TB – https://geni.us/samsung990pro2tb Artic P12 slim fan – https://geni.us/arcticp8 BD790i X3D: Thermaltake Tower 200: https://geni.us/thermaltaketower200 Minisforum BD790i X3D: https://geni.us/minisforumbd790ix3d Cooler Master MWE Gold 850 V2 – https://geni.us/coolermaster850 Crucial 128 GB 5600MT/sec RAM – https://geni.us/crucial128gbramkit Artic P12 slim fan – https://geni.us/arcticp8 https://geni.us/asusgeforcertx5070 Predator 1TB boot drive: https://geni.us/predatorssd1tb Samsung 990 Pro 4TB VM storage: https://geni.us/samsungpro9904tb Join the new HomeLabExplorers community here: https://www.skool.com/homelabexplorers/about?ref=25f64c297b724689ae81c7dd30ba2c21 Check out the VHT forums to get your questions answered: https://www.virtualizationhowto.com/community/ ★ Subscribe to the channel: https://www.youtube.com/channel/UCrxcWtpd1IGHG9RbD_9380A?sub_confirmation=1 ★ My blog: https://www.virtualizationhowto.com ★ Twitter: https://twitter.com/vspinmaster ★ LinkedIn: https://www.linkedin.com/in/brandon-lee-vht/ ★ Github: https://github.com/brandonleegit ★ Facebook: https://www.facebook.com/people/VirtualizationHowto/100092747277326/ ★ Discord: https://discord.gg/Zb46NV6mB3 ★ Pinterest: https://www.pinterest.com/brandonleevht/ Introduction to 3 Proxmox Server builds! - 0:00 Build #3 BD790i X3D motherboard build - 0:50 Downsides of the BD790i X3D motherboard - 2:19 Workarounds and add-ons to the BD790i X3D for connectivity - 3:07 BD795i SE motherboard build high-end efficiency - 3:52 Performance and power draw of this one - 5:14 Downsides of the BD795i SE - 5:28 BD795M motherboard build - 5:47 Specs of this board and my build - 6:24 SATA ports available on this one - 6:52 Pros and cons of the BD795M - 7:33 Thermals and other observations - 7:49 All builds pros and cons - 8:25 Wrapping up the builds and thoughts - 9:51
My Top 3 Proxmox Home Server Builds!
Load More... Subscribe