25 ms·
Companies usually hire editors to manually annotate the quality of the algorithms on anonymized samples. They don't need direct user feedback to gather quality
by rockinghigh 6y ago
Companies usually hire editors to manually annotate the quality of the algorithms on anonymized samples. They don't need direct user feedback to gather quality metrics. You also can't tell which step failed in the pipeline: speech recognition, query understanding, or the actual search.
- jimktrains2 6y agoWhy can't you know which step? It's their system..they can build as much tracing as they want into it. Why would editors make user feedback any less valuable? It's hubris to think it's not.