I am curious how many are using Proxmox with a NAS device to store VMs or containers as your home lab virtual machine storage. If so, what are you storing? Which model are you using? Are you using NFS or iSCSI?
In my setup I store all of my iso images and pbs backups on my synology in an nfs share. All of the actual container and vm drives are on lvm thin local.
@jackalltrades Makes sense, I am not finding a lot of home labbers targeting NAS devices to actually run workloads, mostly local storage. I am wondering how many are actually using Proxmox clustering in their lab environments, or are using Ceph, etc.
I am using a custom NAS server for shared storage. It's a Core i7-4770k, 32GB RAM and a pool of 6 HDDs attached to a HBA. I run ProxMox as the hypervisor and TrueNAS in a VM with the HBA passed through.
Like @jackalltrades, I was running just PBS backups and ISOs there with SATA SSDs in the clustered ProxMox nodes for local thin LVM storage with ZFS as the filesystem. Additionally, I had ZFS set to to sync changes on all of the local drives between all the nodes so that I could run any VM/LXC on any node at anytime. However... ZFS write amplification killed two of the SATA SSDs and left three other drives with less than 20% health after about a year of light use.
I am now using an NFS pool on the NAS for VM storage and iSCSI volumes for the LXCs. I have a Synology NAS running PBS in a VM to back up every the VM image, including the image for the main NAS.
@t3hbeowulf one of the hurdles with iSCSI I have found with Proxmox is the lack of snapshot capabilities. Does this plague you at all? It looks like you only have your LXCs running on the iSCSI volumes. Are these mostly immutable, you drive these with IaC?