The 4090ti is rumoured to be 48GB [1], but who knows when that will release or how much it will cost. If you really need extra VRAM and don't mind longer infere

The 4090ti is rumoured to be 48GB [1], but who knows when that will release or how much it will cost. If you really need extra VRAM and don't mind longer inference, older used Tesla cards are an option. A used Tesla V100 32GB can be sometimes found on Ebay for 1500. [1] https://www.techpowerup.com/gpu-specs/geforce-rtx-4090-ti.c3917 https://www.techpowerup.com/gpu-specs/geforce-rtx-4090-ti.c3...