4 ms·
Can 3090 GPUs share their memory with one another to fit such a large model? Or is the enterprise grade hardware required?
by etaioinshrdlu 4y ago
Can 3090 GPUs share their memory with one another to fit such a large model? Or is the enterprise grade hardware required?
- coolspot 4y agoYes, two 3090s ($1.7k each) can be connected via NVlink with common 48Gb of memory pool. Two RTX A6000 ($4.5k each) can form 96Gb memory pool.