2 ms·
Nvidia has their own market segmentation tactics, like a 24GB 4090 is $2,000 and the 48GB version is $7,000.
by wmf 3y ago
Nvidia has their own market segmentation tactics, like a 24GB 4090 is $2,000 and the 48GB version is $7,000.
- DaiPlusPlus 3y agoWhy not buy 2x24GB cards and use SLI with CUDA? Or does that represent a bottleneck-so-bad that it's a dealkiller and worth the $3000 premium?
- wmf 3y agoSLI no longer exists.
- imtringued 3y agoLlama.cpp wasn't optimized for multi GPU setups. You need to split individual layers onto the GPU instead of simple offloading.