I'd like to know how you do precision/recall testing. I've spent a lot of time doing pairwise testing of SOLR, sphinx and ferret (haven't tried Xapian), checki

I'd like to know how you do precision/recall testing. I've spent a lot of time doing pairwise testing of SOLR, sphinx and ferret (haven't tried Xapian), checking which hits one indexer misses that the other gets, stopwords (increments of 0, 50, 100, 175), combinations of token separators, etc. I don't really have to worry about UTF8 to ascii conversion with my data. I haven't really gotten a rigorous methodology or a good number that says precision and recall are acceptable, aside from lists of (a few hundreds of) test queries per topic where i record numbers of hits i expect.