24 ms·

I’m surprised it doesn’t take advantage of the iPhone’s “neural engine” if it’s available.

by Quenty 9y ago

RubenSandwich 9y ago
Apple uses a different model format[0], so tensorflow models need to be converted first before they can be used. So Apple would need to add support for this tensorflow lite/mobile model format to work in Core ML. [0]https://developer.apple.com/documentation/coreml/converting_trained_models_to_core_ml https://developer.apple.com/documentation/coreml/converting_...
- J0-nas 9y ago
  Another format is onnx [0], where Apple and Goodle don't seem to participate. I don't know the politics behind it but there should be a common format for all libraries/platforms. [0] https://onnx.ai/ https://onnx.ai/
  - stochastic_monk 9y ago
    onnx seems to be an initiative to try to allow Microsoft's and Facebook's AI platforms to compete with Tensorflow. Considering Tensorflow is more a grab at developer mindshare than an ideal platform [for example, its performance lags by a factor of two behind MXNet and Torch], I think it's a smart plan.
    - J0-nas 9y ago
      I don't think the last sentence is fair to trensorflow. Torch has been around for ~15 years compared to the 3 of TF. You'd expect TF to catch up in terms of performance in the future.
      - stochastic_monk 9y ago
        I think it's more than fair. I'm certain that more developer-hours have been spent on TensorFlow than on Torch. They very well may catch up, but that doesn't mean that hype and the Google name aren't the reason it's gotten popular.
- pj_mukh 9y ago
  Question: So does this mean, Tensorflow Lite will have worse performance on iOS than a natively implemented CoreML model of the same design would?
  - RubenSandwich 9y ago
    Not necessarily. They are just data formats that encode the different weights and layers of the neurel net. (That is an oversimplification, but enough to give you a basic grasp of what is happening under the covers.) Apple is obviously investing a lot into CoreML, so expect some speed ups just due to effort but I would not expect factors of magnituite difference in performance. (This might be wrong as Tensorflow Lite is still quite immature, but as it matures I believe it will be comparable in performance.)
jacksmith21006 9y ago
How about support for the PVC in the new Pixel phones?
halflings 9y ago
Another commenter noted that is supported; they provide a tool to convert the tflite model to Core ML format: https://developers.googleblog.com/2017/12/announcing-core-ml-support.html https://developers.googleblog.com/2017/12/announcing-core-ml...

I’m surprised it doesn’t take advantage of the iPhone’s “neural engine” if it’s available.

by Quenty 9y ago

I’m surprised it doesn’t take advantage of the iPhone’s “neural engine” if it’s available.

Apple uses a different model format[0], so tensorflow models need to be converted first before they can be used. So Apple would need to add support for this tensorflow lite/mobile model format to work in Core ML. [0]https://developer.apple.com/documentation/coreml/converting_trained_models_to_core_ml https://developer.apple.com/documentation/coreml/converting_...

J0-nas 9y ago
Another format is onnx [0], where Apple and Goodle don't seem to participate. I don't know the politics behind it but there should be a common format for all libraries/platforms. [0] https://onnx.ai/ https://onnx.ai/
- stochastic_monk 9y ago
  onnx seems to be an initiative to try to allow Microsoft's and Facebook's AI platforms to compete with Tensorflow. Considering Tensorflow is more a grab at developer mindshare than an ideal platform [for example, its performance lags by a factor of two behind MXNet and Torch], I think it's a smart plan.
  - J0-nas 9y ago
    I don't think the last sentence is fair to trensorflow. Torch has been around for ~15 years compared to the 3 of TF. You'd expect TF to catch up in terms of performance in the future.
    - stochastic_monk 9y ago
      I think it's more than fair. I'm certain that more developer-hours have been spent on TensorFlow than on Torch. They very well may catch up, but that doesn't mean that hype and the Google name aren't the reason it's gotten popular.
pj_mukh 9y ago
Question: So does this mean, Tensorflow Lite will have worse performance on iOS than a natively implemented CoreML model of the same design would?
- RubenSandwich 9y ago
  Not necessarily. They are just data formats that encode the different weights and layers of the neurel net. (That is an oversimplification, but enough to give you a basic grasp of what is happening under the covers.) Apple is obviously investing a lot into CoreML, so expect some speed ups just due to effort but I would not expect factors of magnituite difference in performance. (This might be wrong as Tensorflow Lite is still quite immature, but as it matures I believe it will be comparable in performance.)

jacksmith21006 9y ago

How about support for the PVC in the new Pixel phones?

halflings 9y ago

Another commenter noted that is supported; they provide a tool to convert the tflite model to Core ML format: https://developers.googleblog.com/2017/12/announcing-core-ml-support.html https://developers.googleblog.com/2017/12/announcing-core-ml...