Vhtforums

Share:

Notifications

Clear all

What AI tools are you running in your home lab?

Last Post

RSS

Posts: 608

Brandon Lee

Admin

Topic starter

Nov 02, 2025 5:00 pm

(@brandon-lee)

Member

Joined: 15 years ago

Hey all! Just wanted to start a good thread here on what AI tools you are running in your home lab. Here is my shortlist:

Ollama
OpenWebUI
AnythingLLM
WhispherX
Stable Diffusion
ComfyUI

Extending the conversations from my last video to this forum thread:

I'm running some in local Docker Desktop and also Proxmox LXC container with GPU passed through. What about you?

This topic was modified 9 hours ago by Brandon Lee

Topic Tags

ai home lab home server artificial intelligence

1 Reply

Posts: 608

Brandon Lee

Admin

Topic starter

Nov 02, 2025 6:27 pm

(@brandon-lee)

Member

Joined: 15 years ago

Believe it or not, still rocking the GTX 1060 6GB! Check out my blog on this project here: Still Worth It? Running AI Workloads on a GTX 1060 in 2025.

NVIDIA geforce 1060 with 6GB of VRAM running in Proxmox

Have a RTX 4060 in my workstation currently that I run the --gpus all parameter with.

performance view of the RTX 4060

Reply