3 ms·
There's another possible source of selection bias: users may be going to Google for queries that they know are a hard, because they assume that Bing won't have
by nostrademons 16y ago
There's another possible source of selection bias: users may be going to Google for queries that they know are a hard, because they assume that Bing won't have the answer. Of course such queries will fail more often, because they're hard.
Bing's marketing has centered around the head of the query distribution - common tasks where definite answers exist, like how to book a flight. It makes sense that such tasks would succeed much more often than long-tail ones like looking up an obscure error message.
- barista 16y agoWell if they are "going" to Google for hard queries then wouldn't they try the queries on Bing first? Or are you saying that people spend time deciding a query is simple or hard and then choose appropriate search engine for that?
- amalcon 16y agoThey might try the query on Bing, fail, and then try the same query on Google. A large portion of those are likely to fail as well, just because the queries are hard. It's less likely that someone will try a query on Google, fail, and then think "Maybe Bing will do a better job with this."
- barista 16y agoWell in that case wouldn't bing's percentage of failed searches be even larger than Google's? The stats don't reflect that
- amalcon 16y agoIt would cause Google to have a relatively larger proportion of "difficult" searches. Many "difficult" searches on Bing will be repeated on Google, but not the reverse. If you assume that all "difficult" searches fail on both engines as a first approximation, that would mean that Google will fail all the "difficult" searches, while Bing will only fail the "difficult" searches made by people who primarily use Bing.
- nostrademons 16y agoMore that they have certain problem domains where they might pick a given search engine, and that those problem domains are biased toward using Bing for easy searches and Google for hard ones. I'll frequently search for airplane tickets on Bing, for example, while I won't even go to Google for that. But when it comes to looking up obscure programming stuff, I'm not going to bother searching on Bing, I know it'll suck.
- jamesbritt 16y ago"More that they have certain problem domains where they might pick a given search engine, and that those problem domains are biased toward using Bing for easy searches and Google for hard ones." That makes no sense. Why would you, or anyone, alternate with search engines if one of them too often fails to deliver? Why not just use Google all the time and avoid the cognitive overhead? Does Google do a poor job, or a worse than Bing job, with airplane tickets?
- rue 16y agoI use DDG except for local sites, which it doesn't index anywhere near as well as Unca Googs.
- notahacker 16y agoA third possible source would be bias in user samples: If Bing users are on average less sophisticated (plausible given the assumption that less sophisticated users tend to use IE with the default search engine) they are more likely to click through irrespective of search results' relevance or the potential to improve a query. What does the "success rate" of AOL's Google-powered search look like?