3 ms·

Out of curiosity, what problems are you running into? I have never had serious problems with the 'save parameters -> dump graph -> freeze graph -> load up with

Out of curiosity, what problems are you running into? I have never had serious problems with the 'save parameters -> dump graph -> freeze graph -> load up with C API' path with feed-forward networks or various RNNs. Either from Go or from Rust. Admittedly, the documentation in this area is extremely bad and I basically had to figure out myself how to do it, though this was long before 1.0.

sandGorgon 9y ago
The issues with the high level API goes slightly deeper. It looks like some of the graph operations are not available on Android (and equivalently on the desktop) by default[1]. The motivation for this is that we have stricter requirements for computation costs and application size on different platforms. So there is an approach that allows to compile minimal set of operations required to run the graph[2][3]. However it requires Bazel as the primary build tool for the Android app as well. The good news is that the TensorFlow team understands the issue and works on improving the documentation and tooling[4]. That said, would you be able to share any example snippets on how you are persisting and loading these models in your code ? That would be super helpful. Also, im getting the feeling that you are using the deprecated method of saving. I think they are shifting to Metagraph now (not sure about this) https://www.tensorflow.org/versions/master/api_docs/python/tf/train/export_meta_graph https://www.tensorflow.org/versions/master/api_docs/python/t... [1] https://github.com/tensorflow/tensorflow/issues/10254 https://github.com/tensorflow/tensorflow/issues/10254 [2] https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/tools/print_selective_registration_header.py https://github.com/tensorflow/tensorflow/blob/master/tensorf... [3] https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/framework/selective_registration.h https://github.com/tensorflow/tensorflow/blob/master/tensorf... [4] https://github.com/tensorflow/tensorflow/issues/10299 https://github.com/tensorflow/tensorflow/issues/10299
- danieldk 9y ago
  That said, would you be able to share any example snippets on how you are persisting and loading these models in your code ? The relevant code is (still) in private repositories, but I have a deck with some examples using Rust: https://www.dropbox.com/s/t8r056f6wqlktqv/embedding-tensorflow.pdf?dl=0 https://www.dropbox.com/s/t8r056f6wqlktqv/embedding-tensorfl...

sandGorgon 9y ago

The issues with the high level API goes slightly deeper. It looks like some of the graph operations are not available on Android (and equivalently on the desktop) by default[1]. The motivation for this is that we have stricter requirements for computation costs and application size on different platforms. So there is an approach that allows to compile minimal set of operations required to run the graph[2][3]. However it requires Bazel as the primary build tool for the Android app as well. The good news is that the TensorFlow team understands the issue and works on improving the documentation and tooling[4]. That said, would you be able to share any example snippets on how you are persisting and loading these models in your code ? That would be super helpful. Also, im getting the feeling that you are using the deprecated method of saving. I think they are shifting to Metagraph now (not sure about this) https://www.tensorflow.org/versions/master/api_docs/python/tf/train/export_meta_graph https://www.tensorflow.org/versions/master/api_docs/python/t... [1] https://github.com/tensorflow/tensorflow/issues/10254 https://github.com/tensorflow/tensorflow/issues/10254 [2] https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/tools/print_selective_registration_header.py https://github.com/tensorflow/tensorflow/blob/master/tensorf... [3] https://github.com/tensorflow/tensorflow/blob/master/tensorflow/core/framework/selective_registration.h https://github.com/tensorflow/tensorflow/blob/master/tensorf... [4] https://github.com/tensorflow/tensorflow/issues/10299 https://github.com/tensorflow/tensorflow/issues/10299

danieldk 9y ago
That said, would you be able to share any example snippets on how you are persisting and loading these models in your code ? The relevant code is (still) in private repositories, but I have a deck with some examples using Rust: https://www.dropbox.com/s/t8r056f6wqlktqv/embedding-tensorflow.pdf?dl=0 https://www.dropbox.com/s/t8r056f6wqlktqv/embedding-tensorfl...