4 ms·
When using SBERT instead of gpt for this use case, is it paired with some sort of vector database or just all done in code/memory?
by dchuk 4y ago
When using SBERT instead of gpt for this use case, is it paired with some sort of vector database or just all done in code/memory?
- leobg 4y agoYou’d want persistence, since the embedding process takes some time. But you don’t need to go all Pinecone on this. There is FAISS, and there is hnswlib, for example. Like SQLite for vector search.
- gk1 4y agoFriendly reminder that we (Pinecone) have a free tier that holds up to ~5M SBERT embeddings (x768 dimensions). For quick projects, going "all Pinecone on this" could turn out to be the easier and faster option.
- leobg 4y agoPoint taken ;-) I like to stand up for the little guy. I hear Pinecone this and Pinecone that. And nobody seems to pay any attention to the awesome dude who made hnswlib.
- gk1 4y agoWho, Yury Malkov? He won’t be offended… He’s an advisor to Pinecone. :) And yes, both he and HNSW are awesome.
- moneywoes 4y agoWhat about Postgres with pg vector?