9 ms·
Are you able to memory pool two 3090s for 48gb and if so what's your setup? I looked into this previously[1] but wasn't super confident it's possible or what h
by magixx 3y ago
Are you able to memory pool two 3090s for 48gb and if so what's your setup?
I looked into this previously[1] but wasn't super confident it's possible or what hardware is required (2x x8 pcie and official SLI support?).
AFAICT still would look like two GPUs to the system.
[1] https://discuss.pytorch.org/t/is-there-will-have-total-48g-memory-if-i-use-nvlink-to-connect-two-3090/100378/10 https://discuss.pytorch.org/t/is-there-will-have-total-48g-m...
- Tepix 3y agoYou can memory pool with the right software however pytorch supports spreading large models over multiple GPUs OOTB. Just pass the --gpu-memory parameter with two values (one per GPU) to oobabooga's text-generation-webui for example.