3 ms·
IMO vector search is pretty much a solved problem with simple to use, open source libraries like Faiss offering incredible performance out of the box for most c
by freediver 5y ago
IMO vector search is pretty much a solved problem with simple to use, open source libraries like Faiss offering incredible performance out of the box for most commercial use cases.
A much harder problem is creating accurate vectors to begin with. Even the most advanced language models today create word/sentence embeddings that leave a lot to be desired. Not to mention this is slow and GPU intensive.
Creating an end-to-end solution for embedding/searching/ranking (of which vector search is just one component, the other one should be some kind of keyword based search to increase precision) is what would be very valuable to offer as a service.