3 ms·
> so 30 12gb gpus - a 3090 will cost around $1800 3090 has 24Gb, thus 15 GPUs X $1800 = $27,000 in GPUs
by coolspot 4y ago
> so 30 12gb gpus - a 3090 will cost around $1800
3090 has 24Gb, thus 15 GPUs X $1800 = $27,000 in GPUs
- etaioinshrdlu 4y agoCan 3090 GPUs share their memory with one another to fit such a large model? Or is the enterprise grade hardware required?
- coolspot 4y agoYes, two 3090s ($1.7k each) can be connected via NVlink with common 48Gb of memory pool. Two RTX A6000 ($4.5k each) can form 96Gb memory pool.