3 ms·
It's not as bad as you might think, we're speaking dozens of GB across the entire index. I don't think stopwords as an optimization makes sense when you go bey
by marginalia_nu 2y ago
It's not as bad as you might think, we're speaking dozens of GB across the entire index.
I don't think stopwords as an optimization makes sense when you go beyond BM25. The search engine behaves worse and adding a bunch of optimizations makes an already incrediby complex piece of software more so.
So overall I don't think the juice is worth the squeeze.