3 ms·

The authors should have asked an English speaker to proof read first. “Going ahead in an even pace” isn’t correct English and I don’t think it’s at all obvious

The authors should have asked an English speaker to proof read first. “Going ahead in an even pace” isn’t correct English and I don’t think it’s at all obvious without context that it is supposed to mean “Walk in a straight line”. They consistently use “in an even pace” instead of “at an even pace” in their examples.

gcr 3y ago
So what? Lots of amazing research is being spearheaded by English-as-a-second-language learners these days, I don’t think it detracts from the idea in the minds of the target audience. Some day soon, I wouldn’t be surprised if most applied AI research might happen in Mandarin the way most fundamental physics research once happened in German. I’ll have the opposite problem then. If I show ESL speakers some kindness now, maybe they’ll show the same respect when I try to write papers in “broken” Chinese someday :)
- zarzavat 3y ago
  The point is that they are comparing the English comprehension of various models, but their examples range from slightly incorrect to incomprehensible English. They don’t seem to be aware of this, because if you were intentionally testing on incorrect English you would also test on correct English as well to be able to quantify the difference. If I was writing a paper about AI comprehension of Italian and I was not confident at speaking Italian I would definitely want to ask an Italian speaker to check my examples for me.
micimize 3y ago
This was my first thought as well but I don't think it matters and was likely more a result of using real training examples than limitations of the authors. The point of the work is that regardless of perturbations that degrade or complicate clarity, their model is able to extract and enact the motions that seem most implied that would be OOD with the other methods. So this extends to barked under-contextualized commands like at the end with "Leaps forward then stands straight" but also these looser seemingly nonsense statements like "native motions" or w/e. The big tradeoff here is that if it seems overly permissive. It would be very annoying to be talking of a third person and have your robot start dancing due to identity parsing issues.

gcr 3y ago

So what? Lots of amazing research is being spearheaded by English-as-a-second-language learners these days, I don’t think it detracts from the idea in the minds of the target audience. Some day soon, I wouldn’t be surprised if most applied AI research might happen in Mandarin the way most fundamental physics research once happened in German. I’ll have the opposite problem then. If I show ESL speakers some kindness now, maybe they’ll show the same respect when I try to write papers in “broken” Chinese someday :)

zarzavat 3y ago
The point is that they are comparing the English comprehension of various models, but their examples range from slightly incorrect to incomprehensible English. They don’t seem to be aware of this, because if you were intentionally testing on incorrect English you would also test on correct English as well to be able to quantify the difference. If I was writing a paper about AI comprehension of Italian and I was not confident at speaking Italian I would definitely want to ask an Italian speaker to check my examples for me.

micimize 3y ago

This was my first thought as well but I don't think it matters and was likely more a result of using real training examples than limitations of the authors. The point of the work is that regardless of perturbations that degrade or complicate clarity, their model is able to extract and enact the motions that seem most implied that would be OOD with the other methods. So this extends to barked under-contextualized commands like at the end with "Leaps forward then stands straight" but also these looser seemingly nonsense statements like "native motions" or w/e. The big tradeoff here is that if it seems overly permissive. It would be very annoying to be talking of a third person and have your robot start dancing due to identity parsing issues.