3 ms·
Uhhh. NovuMind only does 3x3 convolutions. Literally a hard burnt ASIC. Also, the TPU's efficiency is close. (Btw both their "FLOPs/watt " numbers are useless,
by deepnotderp 9y ago
Uhhh.
NovuMind only does 3x3 convolutions. Literally a hard burnt ASIC. Also, the TPU's efficiency is close. (Btw both their "FLOPs/watt " numbers are useless, they don't account for utilization)
And Cambricon... well, I'll just leave it at that...
- baybal2 9y agoI don't think that relevant. For running NNs, this is pretty much all what you need from an asic hardware - raw floating point matrix multiplications per second. And measuring how much power it takes for it to do so is a good measure of power efficiency.
- deepnotderp 9y agoPretty sure the novumind chip has hard coded the Winograd 3x3 convolution algorithm.
- baybal2 9y agoYou seem to be pretty knowledgeable in the subject. Are you someone working in the field? IC designer?
- dgacmu 9y agopsst, click their username: "Founder of a deep learning chip startup called Vathys.ai (YC Winter 2018)." :) (Edited to answer the below question: Dave Andersen - http://www.cs.cmu.edu/~dga/ http://www.cs.cmu.edu/~dga/ I'm back at CMU full time, but was having too much fun at Google to quit entirely.)
- deepnotderp 9y agoYup, guilty as charged :) EDIT: Question answered :)
- deepnotderp 9y agoYep, Vathys; W18