4 ms·
For a similar ANN/vector search capabilities, https://vespa.ai/ https://vespa.ai/ is a great open-source solution. Elasticsearch may offer some form of ANN too
by ahurmazda 5y ago
For a similar ANN/vector search capabilities, https://vespa.ai/ https://vespa.ai/ is a great open-source solution. Elasticsearch may offer some form of ANN too but need to double check
- sanxiyn 5y agoI don't think Elasticsearch has one yet, but OpenSearch does: https://opensearch.org/docs/latest/search-plugins/knn/index/ https://opensearch.org/docs/latest/search-plugins/knn/index/
- m_ke 5y agoLucene 9.0 just shipped with hnsw support, should make it into ES at some point (https://twitter.com/msokolov/status/1468395332531003393 https://twitter.com/msokolov/status/1468395332531003393) EDIT: ES integration PR: https://github.com/elastic/elasticsearch/issues/78473 https://github.com/elastic/elasticsearch/issues/78473
- ahurmazda 5y agoAh! Great to know. ANN searches are becoming table stakes at this point. Hopefully, we will see more and more platforms adding it to their repertoire.
- jkb79 5y agoYes, Vespa.ai can index billion scale vector datasets https://blog.vespa.ai/billion-scale-knn/ https://blog.vespa.ai/billion-scale-knn/ Vespa also allows expressing hybrid sparse and dense retrieval (WAND for sparse, ANN via HNSW for dense). It's also easy to express multi stage retrieval ranking phases, as vector search alone is not achieving state-of-the-art ranking results, see https://blog.vespa.ai/pretrained-transformer-language-models-for-search-part-4/ https://blog.vespa.ai/pretrained-transformer-language-models...