2 ms·
There are benchmarks within the adjacent field of information retrieval, but in general it's hard to properly validate a search engine because real data is so n
by marginalia_nu 5y ago
There are benchmarks within the adjacent field of information retrieval, but in general it's hard to properly validate a search engine because real data is so noisy and misbehaved, and sample data is so different from real data.
- kreeben 5y agoSure, the problem of information retrieval is not exactly that of web search but they're pretty close. So, from such a knowledgeable person such as yourself, when it comes to this topic, could you remind us, what are some of those benchmarks?
- marginalia_nu 5y agohttps://en.m.wikipedia.org/wiki/Precision_and_recall https://en.m.wikipedia.org/wiki/Precision_and_recall For some standard corpus.
- kreeben 5y ago>> Precision and recall The phrase I was looking for. Thx a bunch! Gonna marginalia that now.
- marginalia_nu 5y agoHaha, ironically it lacks both precision and recall for that topic.