3 ms·
Did I miss it or did they not say how much it costs?
by modeless 3y ago
Did I miss it or did they not say how much it costs?
- mnholt 3y ago$12k each at Thinkmate
- m463 3y agohttps://www.amazon.com/dp/B0CLTDCZ82 https://www.amazon.com/dp/B0CLTDCZ82 $13,744.95
- amelius 3y agoFor that price I'd expect more memory.
- brucethemoose2 3y ago48GB is the most Nvidia can give the silicon. I think AMD could theoretically make a 96GB inference card this gen with their modular memory controller...
- omneity 3y agoAMD offers 128GB on their current Mi250 line and the upcoming Mi300x is said to offer 192GB per card.
- brucethemoose2 3y ago>128GB on their current Mi25 This is 2xGPU, and two very expensive GPUs with HBM. I was thinking they use the 7900 XTX die, and swap out the tiny memory controller dies or somehow double them up (which is infinitely cheaper than redoing the whole big die). They could massively undercut the L40 in cost while still doubling up the vram to 96GB, and doubling the bandwidth as a happy side effect.