3 ms·
Let's compare with a competitor you never heard of: Nvidia RTX 3090: 285 Tensor-TOPs @ 350 W [1] Specialised accelerator: 100 TOPS at less than four w
by WithinReason 4y ago
Let's compare with a competitor you never heard of:
Nvidia RTX 3090: 285 Tensor-TOPs @ 350 W [1]
Specialised accelerator: 100 TOPS at less than four watts [2]
That's a 30x improvement over a GPU in power consumption. Sure, it's inference only, but training and inference are not that different.
[1]: https://wccftech.com/nvidia-geforce-rtx-3090-geforce-rtx-3080-geforce-rtx-3070-graphics-cards-custom-model-roundup/ https://wccftech.com/nvidia-geforce-rtx-3090-geforce-rtx-308...
[2]: https://www.imaginationtech.com/product/img-4nx-mc8/ https://www.imaginationtech.com/product/img-4nx-mc8/
- mrb 4y agoTOPS isn't indicative of actual performance https://semiengineering.com/lies-damn-lies-and-tops-watt/ https://semiengineering.com/lies-damn-lies-and-tops-watt/ Also, this IMG chip is vaporware and they can quote an arbitrarily high TOPS/W by trading voltage & frequency with die area, therefore increasing cost beyond reasonable. I'm not surprised IMG shares no other metric.
- deleted 4y ago[deleted]