3 ms·
Whoever wrote the article must have done a cursory search at best, I'm surprised they didn't mention semantic hashing by Salakhutdinov & Hinton (2007) https://w
by sayonaraman 5y ago
Whoever wrote the article must have done a cursory search at best, I'm surprised they didn't mention semantic hashing by Salakhutdinov & Hinton (2007) https://www.cs.utoronto.ca/~rsalakhu/papers/semantic_final.pdf https://www.cs.utoronto.ca/~rsalakhu/papers/semantic_final.p...
Edit: also, talking about LSH, must check out FAISS library https://github.com/facebookresearch/faiss https://github.com/facebookresearch/faiss and the current SOTA http://ann-benchmarks.com/ http://ann-benchmarks.com/
- mish15 5y agoInteresting. Hadn’t seen it actually. BOW is problematic as a starting point, but this is neat and a long time ago too.
- LuisMondragon 5y agoI'm intrigued by FAISS. Do you know if I can use BERT embeddings with FAISS?
- gk1 5y agoYes. Check out this example with Faiss + Bert: https://www.pinecone.io/learn/faiss-tutorial/ https://www.pinecone.io/learn/faiss-tutorial/
- LuisMondragon 5y agoThis tutorial was excellent. I got everything working in a couple of hours. On CPU alone the similarity search is mindbogglingly fast. Thank you!
- mish15 5y agoWe will add neural hash based ANN to that repo when we get time. I expect HNSW to get pushed out in time for many reasons.