3 ms·
> Has anybody come up with AI tactics specifically aimed at simply generating new grammatical sentences from a single-language corpus? Meaning that the results
by zozbot234 5y ago
> Has anybody come up with AI tactics specifically aimed at simply generating new grammatical sentences from a single-language corpus? Meaning that the results aren't judged by meaning or coherence, but by adherence to a grammar, with an attempt to maximize variety?
Just training an LSTM deep network on the corpus is enough to do that. GPT-3 is much the same, with a lot more training data and a less computationally intensive network architecture than LSTM, to make that huge amount of training data useful.
- phreeza 5y agoA language model approach will learn grammatical/syntactic and semantic patterns at the same time. So "dog walks man" will be less likely than "man walks dog", even though both are valid, grammatically. I think what op was asking for was a mechanism to purely learn grammar, which is more in the realm of GOFAI/old school NLP.