3 ms·
It has lots of flops > The fun bit is that Arcturus is the first GPU accelerator to break through the 10 teraflops floating point barrier 64-bit precision – an
by wrsh07 6y ago
It has lots of flops
> The fun bit is that Arcturus is the first GPU accelerator to break through the 10 teraflops floating point barrier 64-bit precision – and AMD is doing it in a 300 watt thermal envelope for 11.5 teraflops, not a 400 watt one like Nvidia has with its Ampere A100, which weighs in at only 9.7 teraflops at 64-bit precision floating point
It is expensive
> Pricing on the Instinct MI100 was buried in the footnotes, and is $6,400 a pop in single unit quantities. We are going to try to see what the OEMs are charging for it.
You can connect them together in more efficient "hives"
> Having three Infinity Fabric pipes per Arcturus GPU allows a NUMA-like coupling of four GPUs and 128 GB of HBM2 memory into a much bigger virtual GPU, much like UltraPath Interconnect at Intel
Whereas before it was less efficient
> With only two Infinity Fabric ports on the Instinct MI50 and MI60 cards, banks of GPUs could only be hooked to each other in a ring topology and the larger the number of GPUs in the ring, the more latency between the devices.
I'm sure this is an incomplete list of highlights, but these all jumped out at me
- dogma1138 6y agoThe interesting part is that instead of adding a lot (if any really) "matrix multiply add" cores they seem to just dumped a truckload of FP16 cores they claim to have nearly 200 tflops of FP16 in just normal half precision that's kinda bonkers... But the issue is always software, ROCm is currently a joke.
- xbar 6y agoBriefly, what would it take to get ROCm to be CUDA-competitive, as a platform?
- dogma1138 6y agoFeature parity with the core libraries of CUDA. Flawless Windows and Linux support. Software updates released in line with GPU releases, and guaranteed continued support throughout their lifecycle. Full support for consumer grade GPUs and APUs.
- lotyrin 6y agoAm I mistaken or is that instead rather cheap in this segment (compared to A100)?
- wrsh07 6y agoOops, a couple comments have corrected me on that point The a100 is theoretically $12,500 https://www.pcgamer.com/nvidia-ampere-a100-price/ https://www.pcgamer.com/nvidia-ampere-a100-price/
- Voloskaya 6y ago> It is expensive At $6400 this is still only ~50% of the A100 price. But as others have said, it does not really matter while ROCm is still so bad.