I did similar tests on my own corpus when was considering whether to keep semantic search in default path for pond. On 3 months of my own sessions I’ve seen th

I did similar tests on my own corpus when was considering whether to keep semantic search in default path for pond. On 3 months of my own sessions I’ve seen that BM25 search was finding the correct answer in ~61%, where semantic had shown only ~37% of success. After that it was easy for me to make the decision. Got all info on how I did evals in here, if interested: https://github.com/tenequm/pond/tree/main/docs/researches/2608-21-semantic-vs-fts-usage-eval https://github.com/tenequm/pond/tree/main/docs/researches/26...