I have an RTX 3060 on my desktop, and my friend has an RTX 4090 on his desktop turned server. We are both running Stable Diffusion with Dreambooth etc., Llama

I have an RTX 3060 on my desktop, and my friend has an RTX 4090 on his desktop turned server. We are both running Stable Diffusion with Dreambooth etc., Llama (well, he is running Llama, I am running 4-bit Llama), Deep Floyd and so on. Both machines are running Ubuntu, don't know what distros are good for servers. Incidentally, NVDA closed at 429.97 today, an all time high (it was 108.13 last year, after they were banned from selling A100s/H100s to China - it has almost quadrupled in price in a year).