3 ms·
Wow that's cool. I didn't know about it, thanks for sharing! Side note, it looks like the AMD MI250 supports FP16, and the raw TFLOPS is ~15% higher than an Nv
by omneity 3y ago
Wow that's cool. I didn't know about it, thanks for sharing!
Side note, it looks like the AMD MI250 supports FP16, and the raw TFLOPS is ~15% higher than an Nvidia A100 80GB, with a significant advantage for AMD in terms of memory bandwidth. The price range for the two cards seem to roughly overlap.
It seems this card is a pretty good deal barring crazy software edge cases. @AMD, if you ever see this, I would be interested to test your card and publish a complete writeup. I'm currently fine-tuning LLMs on A100/H100 and have a good reference point.