4 ms·

Hi, Adam from DL4j here. I'm really excited to see this. We will work on supporting this format as well. We have a new pytorch like api coming out (dynamic grap

Hi, Adam from DL4j here. I'm really excited to see this. We will work on supporting this format as well. We have a new pytorch like api coming out (dynamic graphs etc), so this fits nicely in to that. I know a lot of cynics are looking at this and are thinking this is all politics. Honestly: I am glad something like this exists as a framework developer. We would like to build an easy to maintain set of benchmarks for perf comparisons and have found that to be hard to do. We were originally going to lean on keras with our model import for this, but if we can get say: dynet and chainer on board with this as well, I think it will help the ecosystem as a whole move forward. (If you're asking "why" it's hard, main reason for us was the primary java interface, we are fixing this with a new python interface based on pyjnius) Overall, I don't think the OpenCL folks will be able to pull this off (the field moves too fast). I feel like this is something the people who actually build the tools should do. Ultimately, I would be surprised if tensorflow didn't hop on board at some point. A lot of ML models are being built in pytorch first now. No one loses having that easily accessible.

hedgehog 9y ago
Hey Adam, I don't know about the "OpenCL folks" but we're able to use OpenCL to exceed TensorFlow + cuDNN throughput on the same hardware for real networks. We (Vertex.AI) mostly care about embedded platforms and we currently use Keras as our research front end but we're open to collaborations.
- agibsonccc 9y ago
  I am talking about their neural net format khronos is working on. We likely dont overlap. I am mostly focused on banking gov and telco. We are supporting this out of interest in being able to run these neural nets in our distribution. We have a few embedded use cases but we will likely write our own graph executioner for arm and the like.
  - hedgehog 9y ago
    Ah, I don't know too much about what Khronos is doing. We have thought about your work from the standpoint of supporting DL4j on a range of datacenter accelerators, we do tune for NVIDIA etc with good results. We're pretty framework and hardware neutral.
    - agibsonccc 9y ago
      Feel free to file an issue on nd4j. That is our tensor lib. https://github.com/deeplearning4j/nd4j https://github.com/deeplearning4j/nd4j

hedgehog 9y ago

Hey Adam, I don't know about the "OpenCL folks" but we're able to use OpenCL to exceed TensorFlow + cuDNN throughput on the same hardware for real networks. We (Vertex.AI) mostly care about embedded platforms and we currently use Keras as our research front end but we're open to collaborations.

agibsonccc 9y ago
I am talking about their neural net format khronos is working on. We likely dont overlap. I am mostly focused on banking gov and telco. We are supporting this out of interest in being able to run these neural nets in our distribution. We have a few embedded use cases but we will likely write our own graph executioner for arm and the like.
- hedgehog 9y ago
  Ah, I don't know too much about what Khronos is doing. We have thought about your work from the standpoint of supporting DL4j on a range of datacenter accelerators, we do tune for NVIDIA etc with good results. We're pretty framework and hardware neutral.
  - agibsonccc 9y ago
    Feel free to file an issue on nd4j. That is our tensor lib. https://github.com/deeplearning4j/nd4j https://github.com/deeplearning4j/nd4j