jkb79

5 ms·

1. 31.▲
   by jkb79 5y ago

   Yes, Vespa.ai can index billion scale vector datasets https://blog.vespa.ai/billion-scale-knn/ Vespa also allows expressing hybrid sparse and dense retrieval (WAND for sparse, ANN via HNSW for dense). It's also ea
2. 32.▲
   by jkb79 5y ago

   It's about choosing the right Transformer model, there are several models which are smaller, with fewer parameters than bert-base which gives the exact same accuracy as bert-base, which you can use on a modern CPU single digit ms, even
3. 33.▲
   by jkb79 5y ago

   >then possibly combine search results with keyword based search (say BM25) to >improve accuracy etc. I am still waiting to see an end-to-end API doing all this > Vespa.ai supports combining dense vector search with keyword search a
4. 34.▲
   Billion-scale vector search using binary-coded representations(blog.vespa.ai)

   10 points by jkb79 5y ago|0 comments