4 ms·
Hi, thanks for the question and sorry for the late feedback :) Yes, its a solr index behind. I did a lot of stuff with LibLinear [1] for my masters, in combina
by tomw1808 12y ago
Hi, thanks for the question and sorry for the late feedback :)
Yes, its a solr index behind. I did a lot of stuff with LibLinear [1] for my masters, in combination with Apache OpenNLP [2]. With a mix of clustering and a lot of fun with lucene (3.x at that time) and sentiment analysis. Now, some years later, I re-thought my pretty buggy approach from the past and wanted to do something with that. A small side product is this bookmarklet.
The crawling is a pretty basic web-scraping approach in Java. Not in-code (like Jsoup), but with a Firefox in a Framebuffer with a Webdriver, because I wanted to be able to have the full power of a modern browser rendering engine, instead of a in-code content-download.
[1] http://www.csie.ntu.edu.tw/~cjlin/liblinear/ http://www.csie.ntu.edu.tw/~cjlin/liblinear/
[2] https://opennlp.apache.org/ https://opennlp.apache.org/