4 ms·
I can buy a DDR5 64GB kit from Crucial for $160. https://www.crucial.com/memory/ddr5/ct2k32g48c40u5 https://www.crucial.com/memory/ddr5/ct2k32g48c40u5 If a $1
by frognumber 3y ago
I can buy a DDR5 64GB kit from Crucial for $160.
https://www.crucial.com/memory/ddr5/ct2k32g48c40u5 https://www.crucial.com/memory/ddr5/ct2k32g48c40u5
If a $1000 GPU came with that, it would blow everything else out-of-the-water for model size. Speed? No. Model size? Yes.
If it came with 320GB, I could run ChatGPT-grade LLMs. That's $800 worth of DDR5.
Instead, I get 24GB on the 3090 or 4090 for $2k.
A $3k LLM-capable card would not be a hard expense to justify.