4 ms·
Has anybody come up with AI tactics specifically aimed at simply generating new grammatical sentences from a single-language corpus? Meaning that the results ar
by pessimizer 5y ago
Has anybody come up with AI tactics specifically aimed at simply generating new grammatical sentences from a single-language corpus? Meaning that the results aren't judged by meaning or coherence, but by adherence to a grammar, with an attempt to maximize variety?
The goal would be to do that well with languages where we know the grammar and can evaluate the results, and through that find a general tactic. Maybe find a few general theories on how much input that takes, and the character of that input.
If you can extract the grammatical rules with reasonable certainty (not likely with a collection of seals, of course) figuring out the content would just be Mad Libs.
- zozbot234 5y ago> Has anybody come up with AI tactics specifically aimed at simply generating new grammatical sentences from a single-language corpus? Meaning that the results aren't judged by meaning or coherence, but by adherence to a grammar, with an attempt to maximize variety? Just training an LSTM deep network on the corpus is enough to do that. GPT-3 is much the same, with a lot more training data and a less computationally intensive network architecture than LSTM, to make that huge amount of training data useful.
- phreeza 5y agoA language model approach will learn grammatical/syntactic and semantic patterns at the same time. So "dog walks man" will be less likely than "man walks dog", even though both are valid, grammatically. I think what op was asking for was a mechanism to purely learn grammar, which is more in the realm of GOFAI/old school NLP.
- phreeza 5y agoI think "grammar induction" is a good search term to get started here.