2 ms·
There's a clear and massive movement of data forward for prediction in a CNN, and all that plus saving intermediate state and then moving the same amount of dat
by varelse 11y ago
There's a clear and massive movement of data forward for prediction in a CNN, and all that plus saving intermediate state and then moving the same amount of data backwards when performing backpropagation.
But don't believe me, don't believe a word I type. Go prove the above wrong by building a killer AlexNet implementation out of this chip. See slide 9 of this presentation for why I don't think you can do this (too much data transfer):
http://www.slideshare.net/embeddedvision/tradeoffs-in-implementing-deep-neural-networks-on-fpgas-a-presentation-from-auviz-systems http://www.slideshare.net/embeddedvision/tradeoffs-in-implem...
- raverbashing 11y agoSlide 9 makes it clear that, for most layers computation takes more time than data transfers If you can reduce the size of the computation units you can have one (or several) for each layer, making it possible to hardwire the transfer between layers