4 ms·
Not quite, there are 128GiB AMD instinct parts, though the prices are very...enterprise: https://www.amd.com/en/products/server-accelerators/instinct-mi250 http
by 65a 3y ago
Not quite, there are 128GiB AMD instinct parts, though the prices are very...enterprise: https://www.amd.com/en/products/server-accelerators/instinct-mi250 https://www.amd.com/en/products/server-accelerators/instinct...
- omneity 3y agoWow that's cool. I didn't know about it, thanks for sharing! Side note, it looks like the AMD MI250 supports FP16, and the raw TFLOPS is ~15% higher than an Nvidia A100 80GB, with a significant advantage for AMD in terms of memory bandwidth. The price range for the two cards seem to roughly overlap. It seems this card is a pretty good deal barring crazy software edge cases. @AMD, if you ever see this, I would be interested to test your card and publish a complete writeup. I'm currently fine-tuning LLMs on A100/H100 and have a good reference point.