2 ms·
Do you scientifically analyze the results? Do you ever try and remove your internal bias? Confirmation bias is a very strong effect in search engine result eval
by KirinDave 17y ago
Do you scientifically analyze the results? Do you ever try and remove your internal bias? Confirmation bias is a very strong effect in search engine result evaluations.
- jerf 17y agoI do this: When Google fails me, I try the other search engines. So far, they fail me too. Is this scientific? No. It is at least more objective, though. And I'm not trying for scientific rigor, just "does it do the task?" It's totally fair, too; that's how Google picked me up in the first place, and anyone else who meets that bar will get my business.
- endtime 17y ago>I do this: When Google fails me, I try the other search engines. So far, they fail me too. There's a case you're missing - that Google doesn't outright fail, but its performance is inferior to Yahoo's or Microsoft's. For example, Google may have the page you're looking for at the bottom of the first page of results (in which case you'd probably be satisfied and not try another search engine), but Yahoo or Microsoft might list it as the first result, which would be superior performance.
- sp332 17y agoIt's just a search engine. It's not science.
- KirinDave 17y agoThat's not how anyone producing a search engine treats it. Data and feedback from users is rigorously analyzed in a statically consistent way that is as scientific as we can afford to make it. Go do some mechanical turking for us, please. :)
- abossy 17y agoIt's information science.
- omouse 17y agoWhen you're analyzing billions and billions of results and can produce a lot of data and can draw verifiable conclusions based on that data, I think it's safe to call it a science. A search engine meant for use by billions of people is not a trivial thing.