4 ms·
What’s in that “Search tool”, could actually be the same solution presented in a different way
by punnerud 2mo ago
What’s in that “Search tool”, could actually be the same solution presented in a different way
- kumama 2mo agocastform founder here. it uses lakebases's native bm25 and vector search and fuses the results using rrf (https://medium.com/@devalshah1619/mathematical-intuition-behind-reciprocal-rank-fusion-rrf-explained-in-2-mins-002df0cc5e2a https://medium.com/@devalshah1619/mathematical-intuition-beh...)
- softwaredoug 2mo agoUsually in these cases you don't need to do much tuning to the retriever. So you just give it BM25 or somesuch. I'm hesitant to say absolutely zero tuning, because there are cases where you do want to say, bias towards trustworthy results or recent results etc to help the model avoid wasting tokens. But probably not much beyond that. You can also just create a param in the tool for the agent that selects for "recent" or "popular" or "trustworthy" in ranking.