4 ms·
For every application of semantic search, I’d love to see what the benefit is over text search. If there a benchmark to see if it improves the search. Subjecti
by omarhaneef 2y ago
For every application of semantic search, I’d love to see what the benefit is over text search.
If there a benchmark to see if it improves the search. Subjectively, did you find it surfaced new papers? Is this more useful in certain domains?
- Quizzical4230 2y agoAll benefits depend on the ability of the embedding model. Semantic embeddings understand nuances, so they can match abstracts that align conceptually even if no exact keywords overlap. For example, "neural networks" vs. "deep learning." can and should fetch similar papers. Subjectively, yes. I sent this around my peers and they said it helped them find new authors/papers in the field while preparing their manuscripts. | Is this more useful in certain domains? I don't think I have the capacity to comment on this.
- feznyng 2y agoOne of the factors is how users phrase their queries. On some level people are used to full text search but semantic shines when they ask literal questions with terminology that may not match the answer.
- woodson 2y agoQuery keyword expansion works quite well for that without semantic search (although it can reduce precision).
- Quizzical4230 2y agoExactly. Full text paradigm has it's own pros and I believe we need those tools in the new vector search to take full advantage. I am planning to add keywords feature where if a user enters something in "quotes", the would need to be in the shown results. Just like you can do with a google search.
- feznyng 2y agoYou might be interested in hybrid search which issues both a full text and semantic search and then merges the results via reciprocal rank fusion.
- Quizzical4230 2y agoThank you! I shall play with it this weekend :D