Also, a few other solutions I can think of to pull off this cloud-like experience are OpenStack:

- Each user would be able to get their own tenant VPC-like experience and have GPU passthrough supported

- There is also a Devstack you can deploy which is easier to deploy than the full-blown OpenStack solution

XCP-ng is another open source solution for running VMs that has native support for GPU passthrough and simple VM management for end users.

There are also management solutions you can add to Proxmox, like Virtualizor or SolusVM. These aren't free, but I think they offer a couple of license tiers that are fairly low cost and even a one-time perpetual license on SolusVM if I am seeing that correctly:

- Virtualizor - https://www.virtualizor.com/pricing/

- SolusVM - https://solusvm.com/pricing-2/

Our company has decided to invest in GenAI, TTS, local LLMs, etc., and we plan to assemble a PC with the following specs: Core i9 Ultra 285k, 128GB RAM, RTX 4080. This PC will be shared within our local network among the 3 of us.

The challenge is that we work in both Windows and Linux environments. I want to use this new PC in a way that each of us has access to our own virtual machine (VM), similar to having individual VPS accounts (like EC2 or Hostinger) but within a local network with local IPs. We should have our own control panel (e.g., like SolusVM) to manage tasks such as restarting the OS, taking snapshots, etc.

I tried Proxmox, but I encountered difficulties in setting up separate logins for each user to access their allocated VPS.

One more critical issue is that we need to share the GPU (RTX 4080) among the three users based on their usage. Since the RTX 4080 doesn't support vGPU, I’m unsure how to configure GPU sharing efficiently.

What would be a good solution for this setup? I would like the following:

1. GPU sharing among the users.
2. Each user should get a local IP for SSH access to their own VM.
3. An open-source solution for managing the environment.