Is it really true, that after updating the ceph to use aes256k keys, the VMs which would mount cephFS would need to have kernel 7.x ?

Can someone confirm this.

If I want to keep the VMs on debian 13 and kernel 6.x then which are my options to use Cephfs ?

okey...edit:

The failure is caused by the Debian Trixie ceph-common package being too old to understand the new 60-character Ceph security keys. Switching to an NFS export is the most reliable path forward.

EDIT2: So now I understand, its proxmox which lacks the newer ceph version support. 20.x is not supported properly with debian 13. Proxmox should offer newer ceph versions than 20.x which by the way EOL is pretty soon. I think 22.x at least should be supported.

EDIT3 got it working:

• VM OS: Debian 13 (Trixie)
• Kernel: 7.x (via trixie-backports) — Provides the aes256k capable kernel module.
• Userspace Tools: Ceph 20.2.4 (via Proxmox ceph-tentacle repo) — Provides the mount.ceph helper that can read the new key format.

In one of my homelab servers running Proxmox PVE (9.2.21) I have 2 VM's running.

One older Debian with 4x VCPU assigned and one more modern based on Debian 12 (bookworm) with 6x VCPU.

The hardware CPU is a 8x core Intel i3-N305 CPU.

The first VM average in below 6% while the other is at about 0.2-0.6% CPU usage.

When I startup a third VM with a GUI such as Zorin OS, configured with 6x VCPU, and put some load on it I can see that the graphs for that first VM drops from average 6% to average 3.5-5% CPU.

How come the graphs in the dashboard of PVE changes?

Because in my mind that first VM who will utilize CPU cycles at about 6% of assigned compute power should remain at this even if there are other VMs also requesting CPU cycles.

We’re planning a small DR setup on one dedicated physical server with two Oracle Linux VMs:

• Oracle Database SE2
• Oracle Forms/Reports and WebLogic

Anyone running something similar on Proxmox with an active Oracle support contract?

Mainly interested in actual support experiences. Has Oracle handled your tickets normally, or asked you to reproduce the issue on another platform? How does support for the Oracle Linux guests work in this setup?

Would appreciate any firsthand experience before we choose the hypervisor.

I wonder after all the recommendations for high availability (HA) and experience with clustering, for a humble HOMELAB, shall one forgo the HA altogether?

Say with just 2 mini PCs, are you better off just run one single and maybe keep the second as a spare or PBS or completely use it for something else? Or maybe have them separate and manage through DC Manager? Because it sounds like having a 2-node cluster is WORST of both worlds.

Anyone with actual experience running a 2-node cluster long-term ?

Hey,

I have a modest single proxmox node. I5 7400 HP prodesk with 32gb ram. I have an lsi controller in it, with 12 crucial mx300 1tb ssds.

Everytime I try to run a backup job, the zfs pool gets suspended due to errors. It only happens when backing up.

The rest of the time there is never any errors. I have transfered files to it at gigabit whilst all the vms are running and monitored for any zfs errors and there aren't any. This pool is 6 months old and has been in 24/7 use with no errors. It is only when I back up. The pool suspends within 2 seconds of pressing backup now.

The ssds are all powered using an external ATX power supply which has a jumper on it to keep it running all the time.

How can I figure out what is going on as I would like to finally start backing up but I am not sure how to deal with this.

Cloning the vms works fine so it's something specific to the backup process.

Thanks!

Huge Proxmox noob here, so bear with me please.
I’ve recently gotten Proxmox installed on my home server and it’s been great so far. I’ve spun up a few services using community scripts and they’ve all worked great. My question is, how many resources, primarily CPU and especially RAM, should I give each LXC? Or if it’s different depending on the program’s function, what category of software should I be dedicating the most RAM to? Unfortunately I have only 32GB DDR4 (fuck ai!!)

Right now I have the following services running:
Navidrome
Invidious
Jellyfin
Dockge
Cinephage
Cloudflared

And eventually I want to get a Debian VM up to run a couple game servers through AMP, and a Mailcow instance.

Trying my best to get more RAM, but I’m willing to accept it if I have to sacrifice a couple services to make sure everything runs well. Thanks in advance for any help!

Noob mistake i guess.

All my data, immich photos, nextcloud files. Wiped

I had a stack of 10+ services. so many config files, no backups.

I put so much work in this thing. And now everything is gone.

I'm gutted.

My main reason for installing proxmox was because i had a Windows backup i wanted to run on a VM. I found out proxmox would let me do that. I downloaded the ISO, flashed an USB and installed it on my homelab. I thought it would prompt me to make a partition so I wouldn't overwrite my homeserver partition. But it just took my main drive and just wiped it. No idea at which step of the install this happened. But i guess I'm gonna start making backups from now on :(

My day is ruined

Breaking News! ;-)

https://github.com/virtio-win/kvm-guest-drivers-windows/pull/1653

https://github.com/virtio-win/kvm-guest-drivers-windows/commit/f5e50c8bed233d96140536701934d55d09a59e8b

Version 0.1.302 is the currently broken one who needs workaround in qemu config for the VM-guest to function properly, so keep an eye on this URL for when update is released (as in newer than 0.1.302):

https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/latest-virtio/

Workaround:

args: -set device.scsi0.discard_granularity=16K

discard_granularity size should match whatever zvol volblocksize you are using (by default 16k in Proxmox 9.x).

I wouldn’t have thought of Proxmox being something to advertise in public space. I think it’s really funny though. Probably >90% of people seeing the Ad have no Idea or usecase for it 😅.

Edit: Apparently the “VMWare Explore on Tour” Event is on the other side of the Street right now.
Cheeky! 😁

Hey,

we are considering to retire a batch of V100 for B60 Pro Dual GPUs as we got a great quote on them. Does anybody have any significant experience with the following aspects of Intel GPUs on proxmox:

• Slicing
• Windows Driver Stability
• AI stability

We don't have to provide real time services and can make all workloads asynchonous, stability and price are much more important to us than performance; As in if we can have two of three of cheap, fast or good, we are ok with cheap and good, doesn't have to be fast.

Any experience with any of the intel arc pro is appreciated.

first let me tell you i have tried and give it a try on Proxmox it is very easy via helper script. but there are some cons and pros too

I'm noob in Computer Sciences so i cant configure on my own by general knowledge if given specific instructions to follow yes i can do that.

the reason i want Proxmox is iam running 4-5 servers on of minipc which are Immich, Adguard Home, Homeassistant, Frigate and some upcoming years i will add some more.

first my most important questions

1: It is better to configure Immich on Docker VM/LXC on Proxmox?
2: what if a just simple setup a Debian base image and install immich on it via docker?
3: how to Recover backed-up data from immich already running on docker ubuntu to this setup? and is the new proxmiox immich is future proof of updates?
4: i have multiple servers running i want to share same storage to other LXC/VM too is that possible too?
5: is this easy to return to my Ubuntu docker setup if my Proxmox doesn't satisfy my needs?

any expert in Proxmox having configured successfully Immich and all my related questions would like to help me i would be very thankful to him/her.

Ive got my proxmox server on a VLAN sat behind an opensense firewall... do i still have to use the proxmox host firewall and CT/VM firewalls?

So I bought a used hp elitedesk G9 that came pre-installed with Windows 11 Pro. Does it make sense to override the install with proxmox and run windows as a vm? Or should I do the other way around and install proxmox on a vm within the Windows 11 Pro OS?

Will I lose access to the Pro OS? Does that matter? lol

Your recommendations are welcome and greatly appreciated. Thank you in advance

Hi,

i upgraded some old VMs from windows server 2012 to 2025 using in place upgrade.

it went fine up to 2022, then it was throwing some errors, when i tried the upgrade to 2025.

I changed the CPU type from x86-64-v2-AES to host, and now it boots.

It doesnt boot with any other x86 CPUs.

Is it an expected behaviour? What could cause this?

PVE version is 9.2.3, with 40 x Intel(R) Xeon(R) Gold 6209U CPU @ 2.10GHz (1 Socket)

3-node PVE + Ceph 19.2.6, following the aes → aes256k migration. Cluster-owned keys are done (PASS: Every service key uses 'aes256k'). I then staged client.admin with --rotate-all-storage-keys --rotate-admin-key --apply. Refreshing consumers has barely started (about 27 sessions still on the old key).

Separately, mon.pve3 won't start. Its RocksDB store is corrupted: Corruption: block checksum mismatch ... store.db/184870.sst, so it aborts with ceph_abort_msg("failed to write to db"). The other two mons are healthy (63 MB stores) and in quorum. pve3 also has a dead OSD with BlueFS corruption, which looks like the aftermath of a watchdog hard reset on 18 Sep.

The dry run now warns that not every monitor can keep two client keys valid, and that I shouldn't add or downgrade monitors while a key is staged. I ran --abort-staged-key client.admin --apply. Step 1 passed ("restored managed copies of 'client.admin' to its current key"), but rollback verification is incomplete until every monitor answers, so --confirm-abort-clients-refreshed can't run.

What is the supported way to get pve3's mon back? Is pveceph mon destroy pve3 followed by pveceph mon create safe while the key is staged and the abort is half-done? Or must the rotation be fully resolved first, and if so, how, with one mon unable to answer?

pveversion and ceph versions output below:

pve-manager: 9.2.20 (running version: 9.2.20/49318c671b82f31e)
ceph: 19.2.6-pve4
ceph-fuse: 19.2.6-pve4

{
"mon": {
"ceph version 19.2.6 (7198987e0613d69ffb68c62f59cf70ce51a10eb7) squid (stable)": 3
},
"mgr": {
"ceph version 19.2.6 (7198987e0613d69ffb68c62f59cf70ce51a10eb7) squid (stable)": 3
},
"osd": {
"ceph version 19.2.6 (7198987e0613d69ffb68c62f59cf70ce51a10eb7) squid (stable)": 5
},
"overall": {
"ceph version 19.2.6 (7198987e0613d69ffb68c62f59cf70ce51a10eb7) squid (stable)": 11
}
}

Hi everyone, I made a new account for this post. I'm going to go a head and post this on a few other forums where there might be some interest. I'm also not sure if anyone solved this problem before, but if they had then the internet long forgot about it. Anyway, I managed to get GPU (the D500) passthrough working on my MacPro 6,1 (the trashcan model) in Proxmox version 9. I know it's a VERY niche problem to have, but I consolidated it all on my GitHub for it.

And yes, I used to AI on the project, so be mad about if you want... idc... I suck at writing guides and papers, so it is what it is. I hope at the very least it can help someone out there if they run into the same issue. At least it's documented.

https://github.com/demonphage-glitch/macpro6-1-d500-proxmox

Hi,

Tried to configure CPU governor from “powersave” to replace “performance”, then I found the CPU loading keep higher.

Loading returned to normal once rollback to “performance”.

CPU is i5-6500T and only 2 options allowed to change between performance and powersave.

Any other configuration could try?

Thanks

I've a mechanical rotating hard disk, put into a USB cage and connected to a Proxmox node (x86 running PVE version 9). The USB cage is a USB 3.0 one, but no matter I put that USB device into a VM, or use the PVE console, I only got around 40MB/s performance. I tried to put the USB cage to another computer (Mac), and I got around 180MB/s performance. So, my question is:

How to get a USB hard disk to have good performance on a Proxmox PVE 9 node?

My performance test is just a dumb write test like:

date ; dd if=/dev/zero of=/dev/sdb bs=40MB count=200 ; date (sdb is the USB disk)

It took 3 minutes something on Proxmox, natively in console or in a VM by USB passthrough.

Thank you for your help.

Edit: the port was running at USB 2 speed, ie. 480M, confirmed by running 'lsusb -vt' on console. That's a cable/port/connector issue. After multiple plug-and-replug on the port, now 'lsusb -vt' shows 5000M speed, ie. USB 3. Thank you for everyone's help here.

Hi everyone,

I’m looking for advice on Windows Server licensing for a hosting environment I manage. I want to understand the most cost-effective and compliant way to offer Windows Server VMs to multiple customers.

My current infrastructure:

• Hypervisor: Proxmox VE
• Physical server: 2 × Intel Xeon E5-2682 v4 @ 2.50 GHz
• Physical cores: 32 (16 cores per CPU)
• Logical CPUs: 64
• Environment: Multiple Windows Server VMs running on the same physical host
• Hosting model: Different customers rent individual Windows Server VMs from me.

What I want to achieve:

I would prefer to let each customer purchase their own Windows Server license instead of including the licensing cost in my monthly VM pricing.

For example, if I provide a customer with a VM configured with 4 vCPUs and 16 GB RAM, can they purchase a license based on the VM's allocated virtual cores instead of requiring me to license all 32 physical cores of the host?

Can customers legally use their own Windows Server licenses on VMs hosted on my shared Proxmox infrastructure?

Can customers license individual VMs based on virtual cores, and what are the minimum core requirements?

If I operate multiple Proxmox hosts and migrate VMs between them for maintenance or fail-over, how does licensing work?

I'm building a test server (2 NVMe + 4 HDD, no internet access) and I have to use mdadm instead of ZFS for the host. I can't use ZFS because of resource limitations in my organization (it has to be mdadm). I know the Proxmox installer only offers ZFS for software RAID, not mdadm.

Has anyone taken an already installed and running Proxmox VE host (single disk) and converted it to an mdadm RAID1 mirror afterwards? Is that practical, or a bad idea?

Or is the only sane way to install Debian 13 first, build the mdadm RAID1 in the Debian installer, and then install Proxmox VE on top of it (the "Install Proxmox VE on Debian 13 Trixie" method)?

If you run it like this, any gotchas? In particular UEFI boot redundancy (ESP on both disks), GRUB, initramfs, and kernel/package updates.

Thanks!

* Second try publishing after receiving quite a few dm since the project was removed from here. I removed the Curl-bashing section as requested. I encourage you to review the code and give me your feedback here :)

I'm used to the Proxmox web GUI. I like it. My muscle memory is built around it. But every once in a while the shit hits the fan (network's borked, a bridge network config went sideways, the web UI won't load...) and I end up on the local console trying to remember the right qm/pct/pvesh incantations, with the pressure of getting that Plex server back online fast.

So I built proxhawk-tui: a text-based console that looks and navigates like the Proxmox web GUI. Same resource tree, same per-object menus, same panels, just rendered in your terminal with box drawing, braille graphs and (optionally) Nerd Font icons.

This is vibecoded. I built it with Claude Code. I directed it, reviewed it and tested it on a real nodes, using an integration test script that hits every panel and verifies writes through the API. Still, I'd rather be upfront about it.

What it does:

• Same layout and menus as the PVE 9 web UI (Datacenter / Node / VM / CT views, tasks & cluster log panel)
• Read and write: Add/Edit/Remove dialogs are generated from the API schema, so you get the same options and defaults as the GUI
• Covers most of the GUI: storage, backups, HA, permissions, SDN, firewall, network (with apply/revert), disks/ZFS/LVM, Ceph, snapshots, clone, migrate, cloud-init...
• Consoles: qm terminal, SSH into Linux VMs without a serial port (finds the IP through the guest agent / neighbour table), pct enter, node shell
• Community Scripts integration: browse and launch the awesome community-scripts.org helper scripts right from the menu (plugin, enable it in F4 > Plugins)
• Batch start/stop/backup, keyboard + mouse, 10 themes, CLI mode (pvetty guests list -o table)
• Tiny footprint: pure bash + the Perl/pvesh already on the node. No daemon, nothing to install besides itself

Install (on a PVE 7/8/9 node, read install.sh ):

Repo: https://github.com/Mrdindon/proxhawk-tui

Credit where it's due: I took some inspiration from other projects, especially pvetui by devnullvoid, which is great and worth checking out. (Mine was actually called pvetui at first, I renamed it to avoid confusion.)

What's next: right now it runs locally on a node only. I'm working on a remote version so you can manage multiple hosts/clusters from one place.

I'd really love feedback: what breaks, what's missing, what panels you'd actually use when things go wrong, whether the keybindings make sense. Issues and PRs welcome. Be gentle, but honest 🙂