4 ms·

Algorithm that summarizes text

19 points by anacleto 12y ago

deleted 12y ago
[deleted]
streamtime 12y ago
Is this available to license or purchase? I could really use this for a partner content sites. It's brilliant!
mct1 12y ago
That was pretty terrible. No matter what I put in I got nothing but word salad.
- deleted 12y ago
  [deleted]
- streamtime 12y ago
  Works great for me. I'm curious as to what your input was?
boomtown21 12y ago
It works amazing with those medium blogs http://genopharmix.com/TuataraSum/medium/medium_summary_enabled.html http://genopharmix.com/TuataraSum/medium/medium_summary_enab...
alexwestin 12y ago
[–]moridin007 1 point 1 day ago comparing this algorithm with the one i wrote for wingztv.com (shameless plug) i am really shocked by how much better these guys algo is. although mine was just kinda was hacked up. it just sees sentences with more words in common and ranks then by it, and then i just grab the top 5. this algo looks a lot more fancy O.o probably why it's a lot better lol. http://www.reddit.com/r/InternetIsBeautiful/comments/2wqq5t/autogenerated_article_summaries_for_mediumcom/ http://www.reddit.com/r/InternetIsBeautiful/comments/2wqq5t/...
random_2azkXJ 12y ago
NLP researcher here. From a simple test, this tool is at the hobby level. The text is not interpreted semantically, because the so-called summarization is nothing but blocks of text from the original text, copied ad-literam. It lacks any kind of rewording. My guess is that for content retrieval it employs the the most rudimentary model one can think of [1], does a plain token indexation, then chooses the blocks with the highest density of non-ordinary words. [1] http://en.wikipedia.org/wiki/Standard_Boolean_model http://en.wikipedia.org/wiki/Standard_Boolean_model
- alexwestin 12y ago
  This is no hobby level system. I've done side-by-side comparisons and they've got something else going on here that beats other systems hands down. You've also seemed to miss the fact that these guys are enabling the context to be controlled using any word.
biomimic 12y ago
Cognitive Computing researcher here. This system utilizes vector space and is based on a development at Lawrence Berkeley National Laboratory: https://www.kaggle.com/c/word2vec-nlp-tutorial/forums/t/12349/word2vec-is-based-on-an-approach-from-lawrence-berkeley-national-lab https://www.kaggle.com/c/word2vec-nlp-tutorial/forums/t/1234... http://genopharmix.com/biomimetic-cognition/in_silico_cognitive_biomimicry.html http://genopharmix.com/biomimetic-cognition/in_silico_cognit... It's designed to mimic the process of human cognition aka AI. It's fairly sophisticated as shown by its results.
p1esk 12y ago
I tried it on a couple of articles, and it failed miserably: http://newscenter.lbl.gov/2005/03/31/a-search-engine-that-thinks-almost/ http://newscenter.lbl.gov/2005/03/31/a-search-engine-that-th... http://www.wired.com/2015/02/silicon-valley-home-schooling/ http://www.wired.com/2015/02/silicon-valley-home-schooling/

19 points by anacleto 12y ago

deleted 12y ago

[deleted]

streamtime 12y ago

Is this available to license or purchase? I could really use this for a partner content sites. It's brilliant!

mct1 12y ago

That was pretty terrible. No matter what I put in I got nothing but word salad.

deleted 12y ago
[deleted]
streamtime 12y ago
Works great for me. I'm curious as to what your input was?

boomtown21 12y ago

It works amazing with those medium blogs http://genopharmix.com/TuataraSum/medium/medium_summary_enabled.html http://genopharmix.com/TuataraSum/medium/medium_summary_enab...

alexwestin 12y ago

[–]moridin007 1 point 1 day ago comparing this algorithm with the one i wrote for wingztv.com (shameless plug) i am really shocked by how much better these guys algo is. although mine was just kinda was hacked up. it just sees sentences with more words in common and ranks then by it, and then i just grab the top 5. this algo looks a lot more fancy O.o probably why it's a lot better lol. http://www.reddit.com/r/InternetIsBeautiful/comments/2wqq5t/autogenerated_article_summaries_for_mediumcom/ http://www.reddit.com/r/InternetIsBeautiful/comments/2wqq5t/...

random_2azkXJ 12y ago

NLP researcher here. From a simple test, this tool is at the hobby level. The text is not interpreted semantically, because the so-called summarization is nothing but blocks of text from the original text, copied ad-literam. It lacks any kind of rewording. My guess is that for content retrieval it employs the the most rudimentary model one can think of [1], does a plain token indexation, then chooses the blocks with the highest density of non-ordinary words. [1] http://en.wikipedia.org/wiki/Standard_Boolean_model http://en.wikipedia.org/wiki/Standard_Boolean_model

alexwestin 12y ago
This is no hobby level system. I've done side-by-side comparisons and they've got something else going on here that beats other systems hands down. You've also seemed to miss the fact that these guys are enabling the context to be controlled using any word.

biomimic 12y ago

Cognitive Computing researcher here. This system utilizes vector space and is based on a development at Lawrence Berkeley National Laboratory: https://www.kaggle.com/c/word2vec-nlp-tutorial/forums/t/12349/word2vec-is-based-on-an-approach-from-lawrence-berkeley-national-lab https://www.kaggle.com/c/word2vec-nlp-tutorial/forums/t/1234... http://genopharmix.com/biomimetic-cognition/in_silico_cognitive_biomimicry.html http://genopharmix.com/biomimetic-cognition/in_silico_cognit... It's designed to mimic the process of human cognition aka AI. It's fairly sophisticated as shown by its results.

p1esk 12y ago

I tried it on a couple of articles, and it failed miserably: http://newscenter.lbl.gov/2005/03/31/a-search-engine-that-thinks-almost/ http://newscenter.lbl.gov/2005/03/31/a-search-engine-that-th... http://www.wired.com/2015/02/silicon-valley-home-schooling/ http://www.wired.com/2015/02/silicon-valley-home-schooling/