3 ms·
It seems that production versions of these cutting edge techniques come out very soon after the paper is released (in this case just a few months). I wonder how
by nharada 10y ago
It seems that production versions of these cutting edge techniques come out very soon after the paper is released (in this case just a few months). I wonder how long the internal development process for these big ML efforts are.
- gwern 10y agoI'm not sure this is all that soon. The first paper using RNNs in an encoder-decoder framework from Hinton et al which blew the top off of phrase-based systems' BLEU scores was back in... 2013? It's been a long time. And it's been an especially frustrating wait because whenever you mention how deep systems have made huge process on translation, someone will be sure to note that Google Translate produces total gibberish for Japanese-English and in general is pretty bad, and then you had to explain that as far as anyone knows, Google may be publishing papers on how RNNs translate great but that doesn't mean they've rolled them out to the public Google Translate yet, which looks like making excuses. Now we get to see a productized version of the RNNs out in the wild.