4 ms·
We got good enough performance for semantic search just with faiss. example similar comments to your submission text: https://hn.garglet.com/similar/comment/41
by naveen99 2y ago
We got good enough performance for semantic search just with faiss.
example similar comments to your submission text: https://hn.garglet.com/similar/comment/41727287 https://hn.garglet.com/similar/comment/41727287
example random query:
https://hn.garglet.com/form/textSearch?input6=We+got+good+enough+performance+for+semantic+search+just+with+faiss.&input7=&page_size=50 https://hn.garglet.com/form/textSearch?input6=We+got+good+en...
example, similar users to me: https://hn.garglet.com/similar/users/naveen99 https://hn.garglet.com/similar/users/naveen99
- imaravind 2y ago@naveen99 That's awesome! But I'm curious how you went about data chunking, embedding etc.? Chose adhoc or applied some trial-and-error approach or something else?
- naveen99 2y agoYes generated embeddings using an LLM… no chunking. Tried a few of models. Clip and Imagebind didn’t work great for text, so went with a text focused one.
- chiccomagnus 2y agoBy chance, have you tried preprocess.co for text extraction + chucking?