4 ms·

Sort of makes sense. You'd need a ground-truth search->document dataset, I think, to test on, though. Seems a bit hand-tuned.

• binarymax 6y ago
  Absolutely! We call it a "judgement list" in search relevance land, and one is required and used for training and testing of a relevance config/model...though the training is often manual, until your configuration and infrastructure are mature enough for learning-to-rank.
  • petulla 6y ago
    Last q: which datasets of this kind are used for SOTA testing or document clustering?
  • binarymax 6y ago
    @petulla we've reached the thread depth limit so I can't reply to your last question, but typically MSMarco is used for SOTA testing of deep learning for search: https://microsoft.github.io/msmarco/ https://microsoft.github.io/msmarco/