Yes, that would be OpenCL/SPIR-V. But you still need to put in the work to optimise convolution kernels for specific hardware. TF has openCL support in the wor

Yes, that would be OpenCL/SPIR-V. But you still need to put in the work to optimise convolution kernels for specific hardware. TF has openCL support in the works, AFAIK outsourced to Codeplay - https://www.codeplay.com/portal/tensorflow%E2%84%A2-for-opencl%E2%84%A2-using-sycl%E2%84%A2 https://www.codeplay.com/portal/tensorflow%E2%84%A2-for-open... Caffe has an OpenCL branch, works on AMD but about quarter of the speed of equivalent NVidia hardware using CuDNN 4/5, mostly due to unoptimised kernels - https://github.com/BVLC/caffe/tree/opencl https://github.com/BVLC/caffe/tree/opencl