3 ms·
Hi, * blogs have a well-defined format, they are relatively easy to crawl and they are wide-spread. Certainly, we can add wiki formats as well. * good idea...
by lkozma 16y ago
Hi,
* blogs have a well-defined format, they are relatively easy to crawl and they are wide-spread. Certainly, we can add wiki formats as well.
* good idea... the modal window is only for the demo, when the widget will be embedded on a website, it will take you to the search result directly. But for the demo I agree that Esc would be natural to use.
* No, the back-end is built from scratch, we crawl the contents of blogs, and run our own scripts to filter out the content, gather statistical data about the words, build expressions and rank them. Most algorithms we use are standard in NLP, a few are more experimental. We do most of the processing in Python and Perl. While we know and love Lucene, we don't use it here. We will write in more detail on our blog about the implementation details.