11 ms·
What TOPS means exactly in "... TOPS*|(INT8) 404 ..." ?
by novaRom 4y ago
What TOPS means exactly in "... TOPS*|(INT8) 404 ..." ?
- capableweb 4y agoTOPS - Trillions of Operations Per Second, used as a benchmark to figure out the performance of the accelerator. In my experience, mostly a marketing number, higher TOPS doesn't actually mean it'll be faster than something with a lower TOPS. As always, you need to do your own benchmarks with your use case in mind.
- novaRom 4y agoWhat kind of operations is not clear. Wether it's a simple logic operation or a FMA is big difference.
- calaphos 4y agoI assume it's int8 operations (FMA would count as 2). At least that's the case with FLOPs, TOPs for AI accelerators is basically the same measure, with the changed acronym reflecting the non float data format.