Using Proxmox with ...
 
Notifications
Clear all

Using Proxmox with a NAS for VM storage

5 Posts
3 Users
0 Reactions
172 Views
Brandon Lee
Posts: 380
Admin
Topic starter
(@brandon-lee)
Member
Joined: 14 years ago

I am curious how many are using Proxmox with a NAS device to store VMs or containers as your home lab virtual machine storage. If so, what are you storing? Which model are you using? Are you using NFS or iSCSI?

4 Replies
Posts: 2
(@jackalltrades)
New Member
Joined: 2 weeks ago

In my setup I store all of my iso images and pbs backups on my synology in an nfs share. All of the actual container and vm drives are on lvm thin local.

Reply
1 Reply
Brandon Lee
Admin
(@brandon-lee)
Joined: 14 years ago

Member
Posts: 380

@jackalltrades Makes sense, I am not finding a lot of home labbers targeting NAS devices to actually run workloads, mostly local storage. I am wondering how many are actually using Proxmox clustering in their lab environments, or are using Ceph, etc.

Reply
Posts: 24
(@t3hbeowulf)
Eminent Member
Joined: 10 months ago

I am using a custom NAS server for shared storage. It's a Core i7-4770k, 32GB RAM and a pool of 6 HDDs attached to a HBA. I run ProxMox as the hypervisor and TrueNAS in a VM with the HBA passed through. 

Like @jackalltrades, I was running just PBS backups and ISOs there with SATA SSDs in the clustered ProxMox nodes for local thin LVM storage with ZFS as the filesystem. Additionally, I had ZFS set to to sync changes on all of the local drives between all the nodes so that I could run any VM/LXC on any node at anytime. However... ZFS write amplification killed two of the SATA SSDs and left three other drives with less than 20% health after about a year of light use. 

I am now using an NFS pool on the NAS for VM storage and iSCSI volumes for the LXCs. I have a Synology NAS running PBS in a VM to back up every the VM image, including the image for the main NAS. 

Reply
1 Reply
Brandon Lee
Admin
(@brandon-lee)
Joined: 14 years ago

Member
Posts: 380

@t3hbeowulf one of the hurdles with iSCSI I have found with Proxmox is the lack of snapshot capabilities. Does this plague you at all? It looks like you only have your LXCs running on the iSCSI volumes. Are these mostly immutable, you drive these with IaC?

Reply