5 ms·
Ugh, this company desperately needs some competition to keep prices in check. AMD really has no one to blame but themselves for their lack of success in ML. The
by modeless 9y ago
Ugh, this company desperately needs some competition to keep prices in check. AMD really has no one to blame but themselves for their lack of success in ML. They could have been a real competitor years ago with a relatively small investment in software but they didn't even start seriously trying to compete with CuDNN until this year.
Edit: I didn't originally see that the die size of this chip is nearly double that of the older Titan XP. Perhaps the price isn't as outrageous as I first thought! I'm actually glad that there's a big enough market now to support this kind of ultra high end product. It's certainly a beast and I want one.
- TheArcane 9y ago> needs some competition to keep prices in check. Prices as well as the tech itself. $3000 and still just 12GB. I wonder why this isn't in the range of ~64/128GB yet... too expensive for the type of memory?
- sliken 9y agoHigh bandwidth GDDR5 is more expensive than DDR4. HBM is more expensive again. On top of that the high bandwidth chips are lower density, and the complexity of higher bandwidth links gets more complicated as you get more chips involved. Low end servers use normal dimm, but typically not many dimms per channel, typically 1-3. But to hit the higher memory configurations you end up putting buffer chips on the dimms which makes them more expensive and also slightly higher latency. So 500GB/sec to 128GB ram using HBM2 would be difficult, expensive, and likely wouldn't fit in today's GPU form factors... yet. GPUs generally seem to be mostly hungry for more bandwidth and not that many cases (percentage wise) is 16GB a major limitation. However in those cases check out the power9, the nvlink that x86's uses for GPU<->GPU communication can be used for CPU <-> GPU communication and avoid the high latency/low bandwidth pci-e links.
- gbrown_ 9y agoNo-one is manufacturing larger stacks of HBM yet so far as I am aware. If there are it's only a small amount.
- andars 9y agoLarger (higher capacity) HBM2 stacks do not yet exist and the manufacturing process is pretty complicated/expensive. It's worth noting that all the stacks end up on the same piece of silicon as the GPU itself. Don't assume that they are holding back tech due to lack of competition. 650 GB/s is pretty impressive.
- krautsourced 9y agoEven if it just were DDR4 (which of course it is not) - have you looked at RAM prices recently? 128GB will cost you upwards of 1000$ alone. I don't even want to think how much 128gb DDR5 or HBM2 (if it did exist) would cost you... about the current price of the card, probably.
- theandrewbailey 9y agoAMD GPUs might not be good at ML, but they are good at cryptocurrencies.