4 ms·

Ah, that's unfortunate to hear. In this case I see grammar_score ranging from 2 (Some errors (the meaning can be understood but it doesn't sound natural in your

by jgmf 4y ago

Ah, that's unfortunate to hear. In this case I see grammar_score ranging from 2 (Some errors (the meaning can be understood but it doesn't sound natural in your language)) to 4 (Perfect)--looks like one of the raters was too generous with a rating of 4. I think this feedback is helping me to realize that we should be more explicit about our philosophy of keeping some of the noise in the dataset and allowing people to filter based on judgments. That said, people do say some strange and ungrammatical things to virtual assistants (not saying this example is representative per se), so it's nice to include some of the odd ones. Thanks!

usr1106 4y ago
Thanks for following up! I guess what happened is a user of your system tried to be funny. In this utterance there are 3 short fully grammatical sentences. And a 4th one which is not very grammatical but fully understandable, commanding the device to clean the carpet :) - Cleaning is good. - Dust is so bad. - Make your miracle. - Cleanly my carpet. [1] [1] original is an ungrammatical imperative Some (more) human review would have been needed. The Finnish samples are full of very weird utterances, too. Some like people might have written over 50 years ago, but nobody would speak like this. Maybe they were reviewed on Mechanical turk with moderate requirements / payment? Well, you get what you pay for...
trhway 4y ago
>people do say some strange and ungrammatical things to virtual assistants with virtual assistants and the likes appearing more and more around one can wonder whether a new language/dialect can emerge for that setting.
- usr1106 4y ago
  Absolutely. I thought the same thing. If virtual assistants [1].were widely used and they don't fully understand all natural language the user might want to use, users will adapt and start to use some restricted language. [1] Personally I think it's a useless concept and the examples in the dataset mostly confirmed my view. Come on, a time zone conversion. Do we want to get so stupid that we cannot calculate it ourselves anymore?.Adjusting a light? Most of us sit too much and standing up is good for your body. Such technology is not only useless, but just bad. Not to mention the surveillance capitalism aspect which is proably also there or even prevailing .

by jgmf 4y ago

usr1106 4y ago

Thanks for following up! I guess what happened is a user of your system tried to be funny. In this utterance there are 3 short fully grammatical sentences. And a 4th one which is not very grammatical but fully understandable, commanding the device to clean the carpet :) - Cleaning is good. - Dust is so bad. - Make your miracle. - Cleanly my carpet. [1] [1] original is an ungrammatical imperative Some (more) human review would have been needed. The Finnish samples are full of very weird utterances, too. Some like people might have written over 50 years ago, but nobody would speak like this. Maybe they were reviewed on Mechanical turk with moderate requirements / payment? Well, you get what you pay for...

trhway 4y ago

>people do say some strange and ungrammatical things to virtual assistants with virtual assistants and the likes appearing more and more around one can wonder whether a new language/dialect can emerge for that setting.

usr1106 4y ago
Absolutely. I thought the same thing. If virtual assistants [1].were widely used and they don't fully understand all natural language the user might want to use, users will adapt and start to use some restricted language. [1] Personally I think it's a useless concept and the examples in the dataset mostly confirmed my view. Come on, a time zone conversion. Do we want to get so stupid that we cannot calculate it ourselves anymore?.Adjusting a light? Most of us sit too much and standing up is good for your body. Such technology is not only useless, but just bad. Not to mention the surveillance capitalism aspect which is proably also there or even prevailing .