4 ms·
> Not immoral or illegal, but using human raters to seed an algorithm can make the results worse ...versus asking an oracle what the "good" results are? It's n
by magicalist 7y ago
> Not immoral or illegal, but using human raters to seed an algorithm can make the results worse
...versus asking an oracle what the "good" results are? It's not clear what you'd propose as an alternative.
- tyingq 7y agoMitigating controls, expecting the bias. At the moment it's a Frankenstein set up with a rules/algorithm based ranking subsequently shuffled around by several separate ML runs with different aims. The FTC did once unearth a Google attempt to purposefully influence the human ratings: http://graphics.wsj.com/google-ftc-report/ http://graphics.wsj.com/google-ftc-report/ (long read, but worth it). Find this section of the paper: "Unable to get positive reviews from raters when Google demoted comparison shopping sites, Google changed the raters' criteria to try to get positive results."