3 ms·
Do any of the vector databases have support for bit embeddings. We have created bit embeddings[1] for sentences and they save a lot of space. Currently we are j
by nutanc 3y ago
Do any of the vector databases have support for bit embeddings. We have created bit embeddings[1] for sentences and they save a lot of space. Currently we are just using numpy and sometimes faiss to search through these bit embeddings. Would love for one of the vector dbs to support bit embeddings natively. Then we don't have to engineer that piece :)
[1] https://gpt3experiments.substack.com/p/building-a-new-embeddingbit-vector https://gpt3experiments.substack.com/p/building-a-new-embedd...
- bckr 3y agoLove this idea. Do you have measurements on how it impacts performance of algorithms?
- esafak 3y agoThese are called binary embeddings, and they have been used successfully at pinterest (https://www.arxiv-vanity.com/papers/1908.01707/ https://www.arxiv-vanity.com/papers/1908.01707/) and Tencent (https://paperswithcode.com/paper/binary-embedding-based-retrieval-at-tencent https://paperswithcode.com/paper/binary-embedding-based-retr...) I can't speak for the competition, but weaviate seems to support them: https://weaviate.io/developers/weaviate/concepts/binary-passage-retrieval https://weaviate.io/developers/weaviate/concepts/binary-pass...