(again, I was referred to this forum via here: https://www.youtube.com/channel/UCrxcWtpd1IGHG9RbD_9380A/community?lc=UgwV41sv_SsTQu60wql4AaABAg.9zLDW57PdS69zNQno3z53m&lb=Ugkxm8Q8S0adqfW-kFvpiKHT1JMi04J88mdQ)
So, for those that are looking to run Ceph (RBD) and/or Ceph FS, I HIGHLY encourage you to download and install/run the Ceph dashboard.
You CAN create replicated RBDs/CephFS from within the Proxmox GUI, but if you want to do more than that (erasure coded pools, for example) and you DON'T want to use the CLI -- then the Ceph dashboard is the way to go.
A LOT of credit goes to YouTuber "apalrd's adventures" where he taught me how to get it installed and up and running, but he was using Ceph version 16.something at the time.
Note that as of this writing, there may still be a "bug" with Ceph version 18.2 and the dashboad where you might not be able to get the dashboard up and running for you. (cf. https://forum.proxmox.com/threads/ceph-warning-post-upgrade-to-v8.129371/page-5)
I found this out the hard way when I was setting up my 3-node HA Proxmox cluster over the Christmas break, so had to redo it a few times, but I DO have the Ceph dashboard, fully deployed now.
It works with Ceph version 17.2(.7) (which is what I am currently running)*
In summary, use these commands to install and run said Ceph dashboard:
# apt install -y ceph-mgr-dashboard # ceph mgr module enable dashboard # ceph dashboard create-self-signed-cert # echo MyPassword > password.txt # ceph dashboard ac-user-create admin -i password.txt administrator # rm password.txt # ceph mgr module disable dashboard # ceph mgr module enable dashboard
The last two steps is basically to restart the dashboard after you've issued the self-signed certificate and added the admin account.
(*In the Proxmox forums discussion about this issue, they mention that they generally DO NOT recommend people going BACKWARDS in version numbers, especially where and when security updates are concerned. So, apply that philosophy based on your risk tolerance/assessment. For me, I'm just using my Proxmox cluster for Windows (and Linux) AD DC, DNS, and Pi-hole, so security is not absolutely critical to me, for this use case.) You be the judge for what you are able to and/or willing to tolerate, from a security risk perspective.)
After that, you can log into the Ceph dashboard at https:// <<your_ip_address>>:8443
From there, if you want to create an erasure coded CephFS, you can do that there.
Note that for erasure coded CephFS, your metadata pool HAS to be a replicated pool. The Ceph dashboard will yell at you if you try to put the metadata also on an erasure coded pool.
The Proxmox GUI is good for created replicated pools.
But it can't do erasure coded pools at all.
The Ceph Dashboard CAN do that.
You define the erasure coded rule, and then apply it to the erasure coded pool that you want.
It works for both Ceph RBD and CephFS as I am using both in my system. (They use the same partition on the Inland 512 GB NVMe SSD that I have in my stack of three Mini PCs.)
As the video that I think Brandon put out, where he mounts the CephFS onto the Linux clients -- I am not 100% sure what the relative advantage of doing that would be vs. making the CephFS into a NFS export and then just mounting the NFS share. *shrugs*
There might be a use case where you'd want to mount the CephFS directly onto a client rather than going over NFS.
But in either case, it's available.
Hope this helps.
