4 ms·
Let's focus a bit at some of the translationd of sentences in my passage: He had broken his leg and he put blades on him. Basilica, who is a little bit of
by YeGoblynQueenne 9y ago
Let's focus a bit at some of the translationd of sentences in my passage:
He had broken his leg and he put blades on him.
Basilica, who is a little bit of mascara with him, got something chocolates and flowers.
Worst you know who it is?
she was Maria, who lost her last year.
Destruction!
All that's absolute gibberish, obviously. The only reson you are able to make some sense out of it is that you have a human-level understanding of language and that you can place the nonsense strings generated by GT into an appropriate context that can give you some information about their intended meaning. Most however are too garbled to make any sense of them- the second string is the most striking one.
This is not "good enough" (as opposed to perfect). That's just terribly bad. If you think it works for you that's only because you're so good at understanding language by dint of your being human (well- I assume).
Of course human translators get it badly wrong. I've read human translations that are not much better than that nonsense above, to be honest. But a reasonably competent human translator will never make the kind of elementary mistakes that automatic translation does. And those elementary mistakes will always escalate to the point that the meaning of longer passages will deteriorate to gibberish.
As to being able to understand basic signs, posters and menus in Greek- you can do that with a good travel guide also. And the travel guide will not claim to be a breakthrough Artificial Intelligence system, like Google claims for GT.
- YeGoblynQueenne 9y agoTo expound a bit on poor human translations- when a human translator can't make sense of a passage in the original language, they'll come up with a meaning that makes sense in the context of the translation so-far. So the final translation will make some sense, even if that sense is not an accurate reproduction of the meaning of the original. When machine translation makes mistakes on the other hand, the translation itself makes no sense. It's not just that its meaning is unconnected to the original; its meaning isn't.
- mseebach 9y agoYes, human translation is better, that's a trivially simple point, but irrelevant for deciding whether machine translation is very good and amazingly useful in the absence of a human translator.
- henrikschroder 9y agoNo, the problem that YeGoblynQueenne points out is that when the current state-of-the-art machine translators get it wrong, they get it hilariously, catastrophically, gibberish-wrong. If a system is 99% right, but the remaining 1% is catastrophically bad, it negates a lot of the part that is actually good. You might end up more confused by the machine translation than you were without it. Machine translations is one of these systems where 99% good simply isn't good enough.
- the_af 9y ago> Machine translations is one of these systems where 99% good simply isn't good enough. I really, really disagree. If 99% lets me understand the gist of an idea, or instructions for something (of course: where there is no risk of harm), I'd take it -- even with the 1% of hilariously catastrophic mistranslations. This means I can go to Japan or Greece and just use Google Translate and be reasonably confident I can manage with a combination of this tool and my human-level understanding of language :) It's definitely good enough for me.
- henrikschroder 9y ago> If 99% lets me understand the gist of an idea The very first example in the article was one where GT gets the words mostly right, but completely misses the point. And if you miss the point, then the original text hasn't been translated. It's merely been decoded, this is the entire point of the article. Calling what GT does "translation" is wrong. Yes, there's absolutely value in decoding signs and texts and simple phrases and directions. It allows you to go to a foreign country and get around without speaking the native language. Great. But a phrasebook can do the exact same thing, except it doesn't claim breakthrough AI machine-consciousness bla bla bla. I'm not as good with words as Hofstadter, so here's his words from the end of the article that summarizes the problem quite nicely: "I’ve recently seen bar graphs made by technophiles that claim to represent the “quality” of translations done by humans and by computers, and these graphs depict the latest translation engines as being within striking distance of human-level translation. To me, however, such quantification of the unquantifiable reeks of pseudoscience, or, if you prefer, of nerds trying to mathematize things whose intangible, subtle, artistic nature eludes them. To my mind, Google Translate’s output today ranges all the way from excellent to grotesque, but I can’t quantify my feelings about it. Think of my first example involving “his” and “her” items. The idealess program got nearly all the words right, but despite that slight success, it totally missed the point. How, in such a case, should one “quantify” the quality of the job? The use of scientific-looking bar graphs to represent translation quality is simply an abuse of the external trappings of science."
- mseebach 9y agoI don't know if Google Translate is "good enough", that's an arbitrary scale. What I do know is that it's a lot better than what existed before. Yes, I'm human and know language, but Google Translate exists to serve humans? The particular paragraph is mangled to the point of being gibberish, yes, and noone with the option to choose between your translation or Google's would give Google's even a second glance. But if I don't, it's that, or a paragraph of text that I can just about identify as being Greek, but which is otherwise, well, Greek to me. But as you concede, with context and human understanding of language, I was able to pick out a few crucial chunks of meaning. Whether it's good enough depends on what I'm trying to achieve. If I'm judging your skill as a writer and storyteller, then obviously not. But if we hung out with Vasiliki, Mitsos and Maria last year and you put that on Facebook, I'd at least know enough to send my sympathy to Mitsos and have a good chuckle over Vasiliki's romantic endeavours, which would probably be what you intended - - which is pretty much the definition of "good enough". As for travel guides and Google Translate, as someone who's travelled extensively both pre and post Google Translate, there is nothing in the difference of experience that doesn't qualify as a breakthrough. I have had fully meaningful (if not exactly deeply philosophical) conversations with people entirely mediated by Google Translate. I'm sorry your experiences have been so different from mine.
- mamon 9y ago>> I have had fully meaningful (if not exactly deeply philosophical) conversations Any conversation can easily become "philosophical" when Google Translate messes up and inserts random garbage instead of intended meaning, and people, instead of dismissing translation as garbage, decide to seek some deeper meaning in it :)
- visarga 9y ago> The particular paragraph is mangled to the point of being gibberish You just discovered the poor quality of LSTM generated text. It might come as a surprise to you, but it's legend between AI researchers :-( If it's not translation (such as in chatbots, image captioning, or computer generated text in general), it's even worse. Unfortunately we can't generate text that makes sense. We can only do it in very specific cases and with lots of errors. Other language models are even worse than LSTMs. The problem is that automated translators don't have real world experience and can't think causally. Humans can, because we are in possession of a body and live inside a complex world. We can experiment to test our hypothesis, GT only sees text and can't test anything.
- visarga 9y agoWould you be willing to try http://www.deepl.com/ http://www.deepl.com/ and say if it is better? Google translate is not SOTA because it has huge volume and they can't afford to use expensive models for free.
- the_af 9y ago> "The only reason you are able to make some sense out of it is that you have a human-level understanding of language and that you can place the nonsense strings generated by GT" I think you're understating the quality of the automated translation here. It's by definition not nonsense if I can derive a pretty accurate picture of the situation by reading it. While flawed, it's not random gibberish. If it were random, I -- not knowing how to read Greek -- wouldn't be able to understand about someone being in the hospital because of a broken leg, about some friends visiting him, and about the social faux pas of the two girls being in the same room as the patient. Yes, some of the mistranslations are funny, but they are not nonsense. If an automated translation is good enough for a human-level understanding of language to parse and derive a decently accurate picture out of it, while not understanding a single word of the original text, then that's an impressive achievement! By the way, those of us who remember the initial results of early Google Translate should be impressed. It was truly, really unusable. It has gone a really long way, to the point I consider using it in places where I really cannot understand a single word or read the script... like in Japan, for example.
- YeGoblynQueenne 9y agoTo restate my previous comment, the fact that you can understand a badly mangled phrase is not evidence that it's not gibberish- it's a testament to your ability to glean meaning even from gibberish. Is a machine that produces gibberish that's not too mangled to understand better than having no translation at all? It certainly is. However, Google's hype machine will not stop there- they consistently overstate the ability of their systems, by a very large margin. If Google was saying "look, we have a machine translation system, it's a bit shit but it gets the job done" that'd be fine. But they don't say that. They pretend their system actually solves machine translation, for real, like AlphaZero solved Go. You just have to watch the triumphant press releases that come out of Google. For instance: https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html https://research.googleblog.com/2016/11/zero-shot-translatio...
- the_af 9y agoI disagree. By definition, if it's gibberish no amount of human-level understanding of language will be able to glean meaning from it. You cannot extract meaning from random noise. This is better than random noise; in fact it's way better than what Google Translate used to manage a decade ago. It's not gibberish. It's just very bad quality. But it helps me extract the meaning, which is not that far from what I do with some of the emails I receive in my day job -- trust me!