I've been doing something similar, but I've had good luck using nomachine. My host machine is a Kubuntu VM running on my Proxmox server, and I switch between u

I've been doing something similar, but I've had good luck using nomachine. My host machine is a Kubuntu VM running on my Proxmox server, and I switch between using a desktop and laptop as guests, also connecting in remotely via wireguard when away from home (which honestly isn't very much these days). I tried using xrdp before, but, at least at the time I tried it a few years back, personally felt I got better performance with nomachine vs. xrdp, although perhaps this has changed now. I've tried x2go with individual applications before, but never the entire desktop, perhaps I'll have to give that a try sometime.