4 ms·
But cuDNN itself is faster than those frameworks, so they are doing something to slow themselves down, and my statement stands.
by vonnik 10y ago
But cuDNN itself is faster than those frameworks, so they are doing something to slow themselves down, and my statement stands.
- p1esk 10y agoAgain, this does not make sense. CuDNN is the highly optimized code to perform a specific numerical calculation (e.g. convolution) on Nvidia GPUs. Frameworks such as TensorFlow or Deeplearning4j can use CuDNN to speed up its convnet calculations, but they don't have to. In summary, your statement is like saying: "Numpy is faster than Python". It feels strange having to explain these things to a creator of a NN framework.
- vonnik 10y agoThat's a false analogy. What I'm saying is not like "Numpy is faster than Python"; it's like "Numpy is faster than some scientific computing that the creators of a Python framework hand-rolled separately." Some frameworks write their own CUDA kernels for operations beyond what cuDNN offers, and also wrap cuDNN. So certain operations may run faster or slower depending on how you choose to execute them with the framework.
- p1esk 10y agoOk, now we can agree.