3 ms·
I was toying with compqring similarity of texts just last night, is there anything that could handle 10k+ sized sparse vectors? Obviously there are tools like l
by _wmd 9y ago
I was toying with compqring similarity of texts just last night, is there anything that could handle 10k+ sized sparse vectors? Obviously there are tools like lucene, but I wanted to mess around in the interactive interpreter
- agibsonccc 9y agoCheck out LargeVis then. The original github repo by the authors has a sparse mode: https://github.com/lferry007/LargeVis/ https://github.com/lferry007/LargeVis/ TSNE didn't scale well no matter what you did to it (hence the newer technique) - in general though you can't beat cosine similarity of TFIDF vectors as a baseline.