3 ms·
That's really interesting. Will you open-source the NLP algorithm?
by xux 13y ago
That's really interesting. Will you open-source the NLP algorithm?
- federkasten 13y agoI am planning to open source it in several months. (Our codes have not been well-commented and well-structured yet... Our implementation and algorithm detail is followings. Its categorizing process is written in Python. Using nltk, it makes corpus with TFIDF model from HN topics and comments. And it generates classifiers from this corpus with SVM algorithm using scipy and numpy. FYI, its web interface is written in Clojure and ClojureScript.
- hnriot 13y agopresumably you've trained it with hand annotated content, or bootstrapped from a few choice hn searches (like ?q=jquery will give you a web tech category)
- federkasten 13y agoYes. You are right. I trained classifiers with hand annotations (about 1000 contents or so)