3 ms·
Hmm This chip is said to perform 25 TOPS. A A100 80GB SXM is said to perform 1248 TOPS. Which is an entire card not a single CPU. You could theoretically achi
by ThinkBeat 3y ago
Hmm
This chip is said to perform 25 TOPS.
A A100 80GB SXM is said to perform 1248 TOPS.
Which is an entire card not a single CPU.
You could theoretically achieve the same with
50 M1076 processors.
Would the benefit be any of:
* a lot cheaper
* more energy efficient.
* small size
* easier to mass produce?
- blovescoffee 3y agoBut for small / embedded models, you'd much much prefer to use this chip from mythic than a huge (and possibly more expensive) a100
- nine_k 3y agoWhat I'd care about here is watts per TOPS. This could be the most important factor for running inference in embedded environments, like directly on cameras, sensors, small drones, implantable medical devices, etc. They say that their chip only consumes about 10% of power compared to a digital GPU of similar computational capabilities.