Using Proxmox with a NAS for VM storage - Proxmox help

RE: Using Proxmox with a NAS for VM storage

Brandon Lee — Fri, 27 Sep 2024 20:32:53 +0000

@t3hbeowulf one of the hurdles with iSCSI I have found with Proxmox is the lack of snapshot capabilities. Does this plague you at all? It looks like you only have your LXCs running on the iSCSI volumes. Are these mostly immutable, you drive these with IaC?

RE: Using Proxmox with a NAS for VM storage

t3hbeowulf — Fri, 27 Sep 2024 04:04:28 +0000

I am using a custom NAS server for shared storage. It's a Core i7-4770k, 32GB RAM and a pool of 6 HDDs attached to a HBA. I run ProxMox as the hypervisor and TrueNAS in a VM with the HBA passed through.

Like @jackalltrades, I was running just PBS backups and ISOs there with SATA SSDs in the clustered ProxMox nodes for local thin LVM storage with ZFS as the filesystem. Additionally, I had ZFS set to to sync changes on all of the local drives between all the nodes so that I could run any VM/LXC on any node at anytime. However... ZFS write amplification killed two of the SATA SSDs and left three other drives with less than 20% health after about a year of light use.

I am now using an NFS pool on the NAS for VM storage and iSCSI volumes for the LXCs. I have a Synology NAS running PBS in a VM to back up every the VM image, including the image for the main NAS.

RE: Using Proxmox with a NAS for VM storage

Brandon Lee — Thu, 26 Sep 2024 21:12:54 +0000

@jackalltrades Makes sense, I am not finding a lot of home labbers targeting NAS devices to actually run workloads, mostly local storage. I am wondering how many are actually using Proxmox clustering in their lab environments, or are using Ceph, etc.

RE: Using Proxmox with a NAS for VM storage

jackalltrades — Thu, 26 Sep 2024 21:03:40 +0000

In my setup I store all of my iso images and pbs backups on my synology in an nfs share. All of the actual container and vm drives are on lvm thin local.

Using Proxmox with a NAS for VM storage

Brandon Lee — Thu, 26 Sep 2024 14:57:36 +0000

I am curious how many are using Proxmox with a NAS device to store VMs or containers as your home lab virtual machine storage. If so, what are you storing? Which model are you using? Are you using NFS or iSCSI?