3 ms·
Underresourced languages also are underresourced in terms of training data for LLMs, and so for smaller languages LLMs do have significantly more problems with
by PeterisP 3y ago
Underresourced languages also are underresourced in terms of training data for LLMs, and so for smaller languages LLMs do have significantly more problems with sometimes generating something that's completely weird and wrong not only in terms of facts but also in terms of language, word choice or grammar.
- dustincoates 3y ago> smaller languages LLMs do have significantly more problems Yeah, I would never try this with, for example, Chichewa or Icelandic. Which is both understandable (like you said, less training data) and a shame, because there aren't many good resources for language learners now.