4 ms·
What is more innovative about CNTK? I mostly use Keras on TF, but am interested in your thoughts.
by Eridrus 10y ago
What is more innovative about CNTK? I mostly use Keras on TF, but am interested in your thoughts.
- IshKebab 10y agoWell apart from the 1-bit multi-GPU SGD (which isn't totally free unfortunately), the main thing is BrainScript (formerly the Network Description Language). This is a DSL that lets you define the neural network as a computational network (which is what it is) but also lets you trivially make it recurrent by using `x = PreviousValue(y)` and `x = FutureValue(y)`. CNTK then works out which subset of the network is recurrent and only unwraps that bit. Other systems like Torch and Tensorflow generally only provide pre-defined recurrent layers, like LSTM and GRU. If you want to make your own you have to deal with a gaping hole in the documentation, and extremely hacky ways of defining recurrence which I honestly never worked out. CNTK makes it trivial.