4 ms·
You can click this bookmarklet to get suggestions on similar pages when you're reading an article that you arrived at from hacker news or reddit. Seems like thi
by rashkov 12y ago
You can click this bookmarklet to get suggestions on similar pages when you're reading an article that you arrived at from hacker news or reddit. Seems like this service uses solr to index the articles as well as their content. Would love to hear more about the indexing strategy from the author.
- tomw1808 12y agoHi, thanks for the question and sorry for the late feedback :) Yes, its a solr index behind. I did a lot of stuff with LibLinear [1] for my masters, in combination with Apache OpenNLP [2]. With a mix of clustering and a lot of fun with lucene (3.x at that time) and sentiment analysis. Now, some years later, I re-thought my pretty buggy approach from the past and wanted to do something with that. A small side product is this bookmarklet. The crawling is a pretty basic web-scraping approach in Java. Not in-code (like Jsoup), but with a Firefox in a Framebuffer with a Webdriver, because I wanted to be able to have the full power of a modern browser rendering engine, instead of a in-code content-download. [1] http://www.csie.ntu.edu.tw/~cjlin/liblinear/ http://www.csie.ntu.edu.tw/~cjlin/liblinear/ [2] https://opennlp.apache.org/ https://opennlp.apache.org/