jgmf

3 ms·

1. 1.▲
   by jgmf 4y ago

   Thank you!
2. 2.▲
   by jgmf 4y ago

   "and darkness fell" Yes, this one caused us some consternation :).
3. 3.▲
   by jgmf 4y ago

   Sorry, we didn't have enough space to fit it on the blog post. You can find the list of languages on page 4 of our paper: https://arxiv.org/pdf/2204.08582.pdf I'll add this to our github repo, too. Thanks!
4. 4.▲
   by jgmf 4y ago

   Ah, that's unfortunate to hear. In this case I see grammar_score ranging from 2 (Some errors (the meaning can be understood but it doesn't sound natural in your language)) to 4 (Perfect)--looks like one of the raters was too gener
5. 5.▲
   by jgmf 4y ago

   Jack here from Alexa. Thanks for the feedback. Quality control was nontrivial, to put it succinctly, but we certainly always want to be better. I'll have to check if the issues you've noticed were detected in the judgement scores.
6. 6.▲
   by jgmf 4y ago

   Hi everyone, Jack FitzGerald here from the Alexa team who created this new dataset, the corresponding code, the leaderboard, etc. I'd be happy to answer any questions you might have, and I'll jump in with the other comments alread