3 ms·
Running a DNN on a phone isn't super hard. Training one is, but running is pretty efficient. They definitely could run a DNN for translation on phones. For exa
by nl 11y ago
Running a DNN on a phone isn't super hard. Training one is, but running is pretty efficient.
They definitely could run a DNN for translation on phones. For example the example seq2seq implementation in TensorFlow[1] would run on a phone fine, and that achieves close to state-of-the-art.
Google uses a DNN for offline speech recognition.
[1] https://www.tensorflow.org/versions/r0.8/tutorials/seq2seq/index.html https://www.tensorflow.org/versions/r0.8/tutorials/seq2seq/i...
- YeGoblynQueenne 11y agoFor example the example seq2seq implementation in TensorFlow[1] would run on a phone fine, and that achieves close to state-of-the-art. Lol no it wouldn't and it doesn't. Either you would have to strip it down too much to fit on a phone, so it would lose performance (and it's far from state-of-the-art anyway, being an example) or it would not fit on your phone, unless you removed everything else from it (and even then). Just to put things into perspective: there are large swaths of the global population that do not even own smart phones. They need translation also, you know.
- nl 11y agono it wouldn't and it doesn't. Either you would have to strip it down too much to fit on a phone, so it would lose performance (and it's far from state-of-the-art anyway, being an example) or it would not fit on your phone, unless you removed everything else from it (and even then). Yes, it is an example program. Nevertheless, to quote: "Even if you want to transform a sequence to a tree, for example to generate a parsing tree, the same model as above can give state-of-the-art results, as demonstrated in Vinyals & Kaiser et al., 2014" Language modelling isn't the same as translation, but it is closely related. Seq2seq as an approach does achieve close to state-of-the-art for translation[1]. Why do you think it won't fit on your phone? A related seq2seq model in TensorFlow comes in at less than 500kb[2]. The (much more complex) Image Recognition demo is designed to run on Android[3]. The new TensorFlow quantization approach[4] will reduce that size and increase performance even more. [1] http://arxiv.org/pdf/1409.3215.pdf http://arxiv.org/pdf/1409.3215.pdf [2] https://github.com/cmusphinx/g2p-seq2seq https://github.com/cmusphinx/g2p-seq2seq [3] https://github.com/tensorflow/tensorflow/tree/master/tensorflow/examples/android https://github.com/tensorflow/tensorflow/tree/master/tensorf... [4] https://petewarden.com/2016/05/03/how-to-quantize-neural-networks-with-tensorflow/ https://petewarden.com/2016/05/03/how-to-quantize-neural-net...
- YeGoblynQueenne 11y ago>> Yes, it is an example program. Indeed. I guess I thought you were saying that this tutorial example could achieve state of the art results. Apologies for the misunderstanding. >> Why do you think it won't fit on your phone? The question is really why do you think it will. You claim it does. You need to show that's true. Can you show me a trained machine translation system using deep neural networks running on a smartphone and having state of the art performance? Until you do (or anyone does) I will remain skeptical. As I should and as should everyone. You can't expect to just claim state of the art performance and have everyone praise your achievement. >> The (much more complex) Image Recognition demo is designed to run on Android[3]. That's a demo. I guess it might be state of the art in demos? Regardless, here's a hint of how practical it is to deploy this demo on users' devices. This bit I quote from the demo's github: The TensorFlow GraphDef that contains the model definition and weights is not packaged in the repo because of its size. So maybe it will run on your phone but good luck sending that to your users. Unless you want them at your castle gates with torches and pitchforks. >> The new TensorFlow quantization approach[4] will reduce that size and increase performance even more. Great news. I'm at the edge of my seat.