2 ms·

Even looking on Amazon, DDR4 seems still a decent bit above $2/GB: 2 x 32GB: $142 2 x 64GB: $318 8GB: $16 2 x 16GB: $64 2TB of 128GB DDR4 ECC: $9,600 (http

Even looking on Amazon, DDR4 seems still a decent bit above $2/GB: 2 x 32GB: $142 2 x 64GB: $318 8GB: $16 2 x 16GB: $64 2TB of 128GB DDR4 ECC: $9,600 (https://www.amazon.com/NEMIX-RAM-Registered-Compatible-Motherboard/dp/B0CP6DSPDJ https://www.amazon.com/NEMIX-RAM-Registered-Compatible-Mothe...) > Servers that support that much are actually cheap (~$200) What does this mean? What motherboards support 2TB of RAM at $200? Most of them are pushing $1,000. With no CPU. It may not hit $50K, but it's definitely not going to be $2K.

AnthonyMouse 3y ago
Here's a server that supports 3TB of memory for $130, you get 3TB by filling all 24 memory slots with 128GB LRDIMMs, 2TB with 16: https://www.ebay.com/itm/176298520843 https://www.ebay.com/itm/176298520843 Here are 128GB LRDIMMs for $98: https://www.ebay.com/itm/196305803969 https://www.ebay.com/itm/196305803969 For 2TB and the server you're at $1698. You can get a drive bracket for a few bucks and a 2TB SSD for $100 and have almost $200 left over to put faster CPUs in it if you want to. That's stinking Optane, would work if you're desperate. Normal 128GB LRDIMMs cost more than other DDR4 DIMMs. You can, however, get DDR4 RDIMMs for ~$1/GB: https://www.ebay.com/itm/186345903230 https://www.ebay.com/itm/186345903230 With 32GB RDIMMs that machine would max out at 768GB, which could still run a 1T model at q4 or grok at FP16. And then it would cost less than $1000. Or find a quad-socket system with 48 memory slots and then use 64GB LRDIMMs ($1.12/GB): https://www.ebay.com/itm/176299295509 https://www.ebay.com/itm/176299295509 The quad socket systems aren't $200, but you can find them for $550 or so: https://www.newegg.com/hp-proliant-rack-mount/p/2NS-0006-3E5N1 https://www.newegg.com/hp-proliant-rack-mount/p/2NS-0006-3E5... Maybe less if you shop around (they're not as common).

AnthonyMouse 3y ago

Here's a server that supports 3TB of memory for $130, you get 3TB by filling all 24 memory slots with 128GB LRDIMMs, 2TB with 16: https://www.ebay.com/itm/176298520843 https://www.ebay.com/itm/176298520843 Here are 128GB LRDIMMs for $98: https://www.ebay.com/itm/196305803969 https://www.ebay.com/itm/196305803969 For 2TB and the server you're at $1698. You can get a drive bracket for a few bucks and a 2TB SSD for $100 and have almost $200 left over to put faster CPUs in it if you want to. That's stinking Optane, would work if you're desperate. Normal 128GB LRDIMMs cost more than other DDR4 DIMMs. You can, however, get DDR4 RDIMMs for ~$1/GB: https://www.ebay.com/itm/186345903230 https://www.ebay.com/itm/186345903230 With 32GB RDIMMs that machine would max out at 768GB, which could still run a 1T model at q4 or grok at FP16. And then it would cost less than $1000. Or find a quad-socket system with 48 memory slots and then use 64GB LRDIMMs ($1.12/GB): https://www.ebay.com/itm/176299295509 https://www.ebay.com/itm/176299295509 The quad socket systems aren't $200, but you can find them for $550 or so: https://www.newegg.com/hp-proliant-rack-mount/p/2NS-0006-3E5N1 https://www.newegg.com/hp-proliant-rack-mount/p/2NS-0006-3E5... Maybe less if you shop around (they're not as common).