2 ms·
When you don't have enough corpus in a given "small language," generation of correct grammar, the right word choice and paragraph-wide coherency go out of the w
by bayindirh 3y ago
When you don't have enough corpus in a given "small language," generation of correct grammar, the right word choice and paragraph-wide coherency go out of the window with LLMs.
You need "Plain old artificial intelligence" systems, which are designed for these languages, which are more complex, more fixed machines but can generate better output with less "knowledge".
Otherwise, LLMs plus small languages without enough corpus become "language in garbage out," and you'll do more damage to these languages.
- raverbashing 3y agoor "plain old natural intelligence" of linguists trying to make sense of it all
- bayindirh 3y agoActually, "plain old artificial intelligence" systems are generally considered "expert" systems, which are in turn designed to "encapsulate and execute" the knowledge of human beings expert on the matter. e.g.: You ask a linguist about nitty gritty details of a language and try to codify as much as possible to a system (e.g. PROLOG), and let the built thing loose on the corpus and see how it works.