2 ms·
There's actually two 1-bit things going on with CNTK 2.0. One is the 1-bit SGD that has long been in CNTK and has been criticized for its weird license. I am n
by justnikos 9y ago
There's actually two 1-bit things going on with CNTK 2.0.
One is the 1-bit SGD that has long been in CNTK and has been criticized for its weird license. I am not a lawyer, but my understanding is it says something like you cannot use this unless you call it from inside CNTK. The terms are not that bad and you don't have to use 1-bit SGD if you don't like them.
CNTK 2.0 has another 1-bit thing going on as well which is binary convolution. This uses the Halide compiler to generate code that is 10x faster than optimized 32-bit convolution. This still seems to be at a proof of concept stage.
Disclaimer: I work at Microsoft.