4 ms·

Can this be used to do automatic summarization? I have been really interested in that topic, and I've played with TextRank and LexRank, but they don't provide a

by mendeza 10y ago

Can this be used to do automatic summarization? I have been really interested in that topic, and I've played with TextRank and LexRank, but they don't provide as meaningful summarizes as I would want.

samfisher83 10y ago
No I don't think it can do that. It can classify text. So suppose you have a bunch of sentences that describe cars, a cat etc. If you feed in data it can tell you if the data is about a car or a cat.
- mendeza 10y ago
  Thanks for the input! Text classification and semantic analysis seemed vague to me, so the clarification helped :). Maybe classifying text can help improve automatic summarization, as sentences that include or describe the main topic the best, should be in the summary.
nl 10y ago
Back in 2003-2005(!) I wrote a thing called classifier4j[0] which also did summarization. HP Labs in Brazil did a fairly comprehensive benchmark[1] of summarizers last year, which classifier4j won[2]. I'm quite surprised that (a) they found classifier4j at all, (b) they bothered to test it, and (c) it won, but anyway... [0] http://classifier4j.sourceforge.net/ http://classifier4j.sourceforge.net/ [1] https://www.semanticscholar.org/paper/A-Quantitative-and-Qualitative-Assessment-of-Batista-Ferreira/cf17c2eadd207cdc1e06b6fb0fa0881450e686a2 https://www.semanticscholar.org/paper/A-Quantitative-and-Qua... [2] https://www.semanticscholar.org/paper/A-Quantitative-and-Qualitative-Assessment-of-Batista-Ferreira/cf17c2eadd207cdc1e06b6fb0fa0881450e686a2/figure/3 https://www.semanticscholar.org/paper/A-Quantitative-and-Qua...
rsiqueira 10y ago
I'm also searching for automatic text summarization and I found a list with the 100 best automatic summarization software from GitHub. I would like to know what are the best from this list: http://meta-guide.com/software-meta-guide/100-best-github-automatic-summarization http://meta-guide.com/software-meta-guide/100-best-github-au...

by mendeza 10y ago

samfisher83 10y ago

No I don't think it can do that. It can classify text. So suppose you have a bunch of sentences that describe cars, a cat etc. If you feed in data it can tell you if the data is about a car or a cat.

mendeza 10y ago
Thanks for the input! Text classification and semantic analysis seemed vague to me, so the clarification helped :). Maybe classifying text can help improve automatic summarization, as sentences that include or describe the main topic the best, should be in the summary.

nl 10y ago

Back in 2003-2005(!) I wrote a thing called classifier4j[0] which also did summarization. HP Labs in Brazil did a fairly comprehensive benchmark[1] of summarizers last year, which classifier4j won[2]. I'm quite surprised that (a) they found classifier4j at all, (b) they bothered to test it, and (c) it won, but anyway... [0] http://classifier4j.sourceforge.net/ http://classifier4j.sourceforge.net/ [1] https://www.semanticscholar.org/paper/A-Quantitative-and-Qualitative-Assessment-of-Batista-Ferreira/cf17c2eadd207cdc1e06b6fb0fa0881450e686a2 https://www.semanticscholar.org/paper/A-Quantitative-and-Qua... [2] https://www.semanticscholar.org/paper/A-Quantitative-and-Qualitative-Assessment-of-Batista-Ferreira/cf17c2eadd207cdc1e06b6fb0fa0881450e686a2/figure/3 https://www.semanticscholar.org/paper/A-Quantitative-and-Qua...

rsiqueira 10y ago

I'm also searching for automatic text summarization and I found a list with the 100 best automatic summarization software from GitHub. I would like to know what are the best from this list: http://meta-guide.com/software-meta-guide/100-best-github-automatic-summarization http://meta-guide.com/software-meta-guide/100-best-github-au...