5 ms·

There are a ton of libraries and tools available for NLP, so I feel that side is relatively mature. What I want are more tools for Natural Language Generation.

by deegles 10y ago

There are a ton of libraries and tools available for NLP, so I feel that side is relatively mature. What I want are more tools for Natural Language Generation. Can anyone recommend some good ones? (beyond what's on Wikipedia)

mwexler 10y ago
+ this. It's actually much harder than folks think; most solutions are still rules and sentence fragments that you string append. Automated Insights and Narrative Science are both doing interesting work, but more is needed here. (...though I don't agree that NLP is mature, just more mature than this. Lots of room to improve NLP as well!)
will_pseudonym 10y ago
I'm not sure what methods they use, but the "single sentence reply suggestions" created by Google's Inbox are the highest quality natural language generation that I have come across.
- tyingq 10y ago
  I believe this is the paper that describes the approach they are using: http://www.kdd.org/kdd2016/papers/files/Paper_1069.pdf http://www.kdd.org/kdd2016/papers/files/Paper_1069.pdf Looks less like NLG, and more like picking existing responses from a (probably huge) corpus using ML. Hard to replicate unless you have access to the kind of data Google has.
  - will_pseudonym 10y ago
    If you think about it, all natural language generation is simply picking from a list of possible words to go next. They just do that at a sentence level.
    - tyingq 10y ago
      Heh. I suppose, if you have enough sentences to choose from for the various combinations of words, tenses, conjugations, prepositions, and so forth. Can't imagine there's many entities that would have that much data.
tyingq 10y ago
I tried playing around with NLG a couple of years ago. The only tool I was able to get up and running well enough to do anything was SimpleNLG[1]. It's java, not my forte, but was straightforward otherwise. Here's a basic example of use: https://github.com/simplenlg/simplenlg/wiki/Section%20V%20%E2%80%93%20Generating%20a%20simple%20sentence https://github.com/simplenlg/simplenlg/wiki/Section%20V%20%E... [1]https://github.com/simplenlg/simplenlg https://github.com/simplenlg/simplenlg

by deegles 10y ago

mwexler 10y ago

+ this. It's actually much harder than folks think; most solutions are still rules and sentence fragments that you string append. Automated Insights and Narrative Science are both doing interesting work, but more is needed here. (...though I don't agree that NLP is mature, just more mature than this. Lots of room to improve NLP as well!)

will_pseudonym 10y ago

I'm not sure what methods they use, but the "single sentence reply suggestions" created by Google's Inbox are the highest quality natural language generation that I have come across.

tyingq 10y ago
I believe this is the paper that describes the approach they are using: http://www.kdd.org/kdd2016/papers/files/Paper_1069.pdf http://www.kdd.org/kdd2016/papers/files/Paper_1069.pdf Looks less like NLG, and more like picking existing responses from a (probably huge) corpus using ML. Hard to replicate unless you have access to the kind of data Google has.
- will_pseudonym 10y ago
  If you think about it, all natural language generation is simply picking from a list of possible words to go next. They just do that at a sentence level.
  - tyingq 10y ago
    Heh. I suppose, if you have enough sentences to choose from for the various combinations of words, tenses, conjugations, prepositions, and so forth. Can't imagine there's many entities that would have that much data.

tyingq 10y ago

I tried playing around with NLG a couple of years ago. The only tool I was able to get up and running well enough to do anything was SimpleNLG[1]. It's java, not my forte, but was straightforward otherwise. Here's a basic example of use: https://github.com/simplenlg/simplenlg/wiki/Section%20V%20%E2%80%93%20Generating%20a%20simple%20sentence https://github.com/simplenlg/simplenlg/wiki/Section%20V%20%E... [1]https://github.com/simplenlg/simplenlg https://github.com/simplenlg/simplenlg