3 ms·
What are the chances of TensorFlow code gradually optimizing for TPUs over GPUs?! (Yes TF is OSS, but realistically Google is putting much more resources into
by yazr 9y ago
What are the chances of TensorFlow code gradually optimizing for TPUs over GPUs?!
(Yes TF is OSS, but realistically Google is putting much more resources into it)
- adyavanapalli 9y agoThere is already preliminary support for TPU devices in the TF API.
- dgacmu 9y agoVery low. A lot of the performance on GPUs comes from Nvidia's optimizations in CuDNN -- it's mostly a matter of making sure TensorFlow feeds the right formats/etc. to CuDNN for core NN ops. TF should run well on CPUs, GPUs, TPUs, and likely future embedded accelerators (via tensorflow lite, which already supports the Android Neural Networks API). (I'm part time on Brain, but, of course, this isn't some kind of Official Statement(tm)).
- DannyBee 9y agoTF funds one of my teams explicitly just to optimize CPUs and GPUs. Every discussion i've had with them tells me they care about making customers succeed, period. So i'm going to with "pretty low".