8 ms·
Bing: Why Google’s Wrong In Its Accusations
- kenjackson 16y agoGood article (a surprisingly heartfelt article -- odd for a tech blog). Key paragraphs: Bing says it does NOT do this. It says there is no Google specific search signal that it being used, no list of all the popular pages as selected just by Google users. Instead, it has a 'search signal' based on searching activity observed across a range of sites. For example, if you did a search on Amazon, Bing might detect that. A search on eBay might get spotted. A search on Yahoo, that also might get extracted. Any number of searches might be identified. Bing would associate the next page you went to after doing those searches as being a possible 'answer' to those searches.
- deleted 16y ago[deleted]
- o_nate 16y agoI think comparisons to Amazon or eBay search are misleading. Amazon only indexes and searches its own site - the same goes for eBay. So of course these companies wouldn't mind if Bing copied some of their search results - after all, this would only end up driving more traffic to their sites - since their search results link back to their own sites. It's a much different case when Microsoft is copying search results from Google or another whole-web search site. There Microsoft is directly competing with their product, and the bottom-line is that it's fundamentally fishy for Microsoft to be using their own search results against them.
- encoderer 16y agoCopying search results. I love the notion of that. Somewhere in the world at this moment there's a person with the Bing Toolbar installed searching for something using Google. One of his results is to a website, for the sake of narrative lets suppose it's one of our own: A YC startup. The searcher clicks to the YC startup, it's exactly what he's looking for, he converts. Now, another searcher, using Bing by choice, searches that same term. That YC startup is in the results. The click is made, another conversion happens. The first user consented to his click analysis by installing the toolbar. The startup will surely agree that yes, we are a very good result for that term! We should show up on Bing, DDG, Google, Whatever! And we don't care how we get there! The second user gets a result that's maybe ranked higher because of the first users click was noticed by Bing. Google doesn't lose a customer because the second searcher was already on Bing to begin with. Bing does nothing but analyze their own users' behavior (users of their toolbar) to deliver better results. I find controversy over this beyond absurd.
- joesb 16y ago> The first user consented to his click analysis by installing the toolbar. The toolbar says nothing about taking his data to improve Bing, only for Site-Suggestion which, to average user, is clearly a browser feature. > Google doesn't lose a customer because the second searcher was already on Bing to begin with. What about one who could have converted to Google if he search on Bing and didn't find a result? Google couldn't lose a customer but there's no way Google would gain a conversion from Bing in this situation. > Bing does nothing but analyze their own users' behavior Assuming that this is a search result that Bing wouldn't have found by itself, then this "user behavior" wouldn't have occurred for Bing to capture had Google not exist. Without Google each user can then probably only have behavior of clicking same old web site they have collected from long ago, there's no search engine for them to learn new relevant site easily.
- encoderer 16y agoDon't take it personally that I'm not going to "line by line" your comment the way you did mine -- I'm pretty busy today. But the issue is, my clickstream is mine. If I chose to share it with somebody -- Bing, Google, My Mom -- it's my choice. If I, as a user, don't want Bing to have access to my clickstream, I won't install their toolbar. But if I do, it's not Google's business.
- indyank 16y agoThe issue is simple..google uses all its heavy resources to rank that startup as #1. (good or bad).But bing just uses their toolbar to capture that information and rank them. They call this "cost cutting".Doesn't this sound cheap?
- moultano 16y agoSo it somehow eluded them that most of the searches done anywhere are done on Google? I don't buy it. If you have a "search signal" it's going to be effectively a "Google signal," and they aren't being honest if they contend otherwise.
- nollidge 16y agoThey didn't say "web search", they said "search". Nearly every website has a search box. Most of my searches in any given day are not on Google - they're on Amazon, Wikipedia, Netflix, StackOverflow, Facebook, etc. Bing's toolbar is watching all of those.
- rbanffy 16y agoMost of the searches I do are on the firefox search field. If I want to search within a specific site, I use the "site:" parameter to restrict results by domain.
- endtime 16y agoThe number of people who use that feature is not of statistical significance.
- nowarninglabel 16y agoAnd your data showing is....where? I can of course say, I use this feature, and of course point to others who do, but I don't have data to say it is significant. However, you have stipulated it is not, but have not provided any data to prove it.
- endtime 16y agoI don't have any data showing that, but come on. Think about alllll the people out there who log into Facebook by Googling "www.facebook.com". That's your average internet user, not you and me.
- ChuckMcM 16y agoGiven that Bing clearly uses the clickstream to influence its results pages, at what point to SEO folks run farms of machines in a network which resolve 'google.com' to a process that returns a fixed set of results for a given query? Imagine this scenario, I create 10,000 VM instances of windows running IE8 with the Bing toolbar. I create a local host to 'stand in' for Google such that it emulates the actual Google site (one could even used scraped Google content) and for my 'target' query it returns my spammy results, and then my VM machine clicks on one of the spammy links. It seems that Google's sting worked because their queries had small return rates, but with some resources it would seem a viable way to inject SEO love right into the bloodstream of Bing's ranking algorithm. As I see it, a whole new front just opened up for spammers. --Chuck
- dminor 16y agoSure, but I'm hard pressed to think of a technique that the spammers wouldn't attempt to game. Search engines and spammers will probably always be in a perpetual arms race no matter what the methodology.
- kenjackson 16y agoEasy to circumvent. Spend 5 minutes thinking of how to do it. I suspect you'll think of at least a couple of ways. The battle against spammers will continue to be cat and mouse game. And when one of your signals gets exposed, of course it will be a target. There's nothing new here. In fact, I think most spammers already assumed that the toolbar clickthroughs fed into both Bing and Google toolbars. I did.
- fname 16y agoWell, Google should do nothing less than encourage people to use those spammy methods either stop the practice all together or force Microsoft to lessen the weight is uses for that particular signal.
- encoderer 16y agoThis is like gaming Google Suggest. You're going to need a lot of IP's because they're not idiots in Redmond OR Mountain View and it's pretty simple to detect behavior like that coming from a single IP. If the spammer gets 10,000 IPs then more power to him. But there's probably more cost effective ways of black-hat SEO.
- dave777 16y agoI would wager most of the people commenting don't work in search and how to use datamining to improve search. I think it is useful to see the perspective of someone that actually thinks long and hard about building these types of systems before commenting on whether it is fair or innovative or just plain stealing. http://hunch.net/?p=1660 http://hunch.net/?p=1660
- muro 16y agoFrom the article (about spell correction): > Well, above is the same situation where Bing gets a misspelled word right — a link to a definition of the correctly spelled word at the top of the list. But it’s very unlikely it figured this out from Google, given that for the misspelling, Google doesn’t auto-correct the word nor provide the same answer. Perhaps because people first click on the spell correction and then on the result - so maybe they don't yet copy also the spell correction, only the results. I think this is even stronger that they copy the results, not weaker.
- flatline 16y agoFrom this article: "We’re not going to stop using that signal, unless it messes up relevancy. It doesn’t make sense to exclude that large amount of traffic from our usage set," Weitz said. From the TechCrunch article a few days back [1]: "Google had employees log onto ms customer feedback system and send results to Microsoft." (to which Matt Cutts replied: normal people call that "IE8") Unlike many others, I do not think this is a cut-and-dry issue, but the squirrelly responses from the MS folks on this have really made me think they are just up to no good, true to the form of so much of their corporate history. Arguing with vague technical terms and ad-hominem attacks are not a good way to convince a highly technical crowd of your virtues. [1] http://techcrunch.com/2011/02/01/bing-google-fight/ http://techcrunch.com/2011/02/01/bing-google-fight/
- vash_stampy 16y agoFrom the article: "Meanwhile, I’m on my third day of waiting to hear back from Google about just what exactly it does with its own toolbar. Now that the company has fired off accusations against Bing about data collection, Google loses the right to stay as tight-lipped as it has been in the past about how the toolbar may be used in search results." And Google's sudden silence you don't find suspicious. This is the same company that invited the author of the original article to their headquarters the day after he wrote it.
- varjag 16y agoYou suggest Google Toolbar collects Bing search results?
- vash_stampy 16y agoInadvertently like the Bing toolbar. It has been shown to log every pageview like Bing toolbar. Whether they filter out the pageviews when a user goes to Bing no one knows besides Google. (ie: The article below shows they definetly do not filter it out at the application level as a Yahoo query is sent back by the Google Toolbar and Yahoo now runs on Bing). http://www.benedelman.org/news/012610-1.html http://www.benedelman.org/news/012610-1.html
- vash_stampy 16y agoRound and round the speculation wheel goes! Where it stops, no one knows!
- rwaliany 16y agoI worked on the Bing AI team (pre-launch), they didn't copy Google. If anything, both search engines copy wikipedia. I believe that this was the click-stream research done by an intern researcher from UBC.
- jdp23 16y agoVery clear writeup. I thought this was an excellent point: "PR is not leading this dispute. It’s following behind. This dispute is happening because real engineers at Google felt there was a deep injustice going on — as reflected in the quote from Google’s Amit Singhal in my original article. I’ve known Singhal for years. I’ve never seen him speak like this before. It’s not because Google PR told him to. It’s because he’s fundamentally bothered by what he’s seen — as are members of his team. This dispute is also happening because real engineers at Bing feel there’s a deep injustice going on — as reflected in the quote from Harry Shum above. Bing’s worked incredibly hard to build a search engine that’s worthy of respect. Now here’s Google suggesting that Bing has simply cheated its way to relevancy." The conversation with moultano on a thread a couple days ago was a good example of this. http://news.ycombinator.com/item?id=2177354 http://news.ycombinator.com/item?id=2177354
- joblessjunkie 16y agoSo Microsoft's defense is that they are not copying Google in particular -- they are copying every search engine?
- gniv 16y agoExactly. http://www.bonkersworld.net/2011/02/04/copying/ http://www.bonkersworld.net/2011/02/04/copying/
- grhino 16y agoUsing what people click on from search results from competing search engines sounds like copying the competition to me. It sounds like they automated the process of piggy backing off the work of other search engines, not just Google. They should exclude all competing search engines from this process.
- gojomo 16y agoDoesn't this passage suggest that Google ignores robots.txt in its own cross-comparisons of search relevancy: Google said in October that it found statistical evidence that Bing suddenly became more Google-like. More listings in the first page of results of both search engines seemed to match, as did more of the number one results. How would you get statistically significant results for such things, over time, without constant automated probe queries against Bing? I think such probes are both legal and wise... but Google should drop the pretense that robots.txt is a sacred barrier across which no analysis can be done, no matter how indirect or for what purpose. Also, I'd wager at some time in its history – if not constantly even today – Google has shown panels of users results from Google and its competitors in various combinations – side-by-side, with and without branding, intermixed randomly – and used their reactions to detect areas where the competitors are doing well, and Google could improve. Further, either human eyes or algorithms then tried to determine adjustments to close any gaps in user satisfaction. The net effect of any such process is – surprise, surprise! – leveraging strengths of other engines to patch weaknesses in Google. This is normal, expected behavior by any serious search competitor.
- Jabbles 16y agoI think there is a major difference between identifying areas for improvement and copying a specific search result from a competitor.
- gojomo 16y agoI don't see it as that different. If the panel suggests a competitor's top-10 result is strongly preferred, and then Google examines why they didn't have that in their top-10, and tinkers with their weightings until they do, then they've used a competitor's output signals to train their own systems.
- moultano 16y ago>I don't see it as that different. It is very very different. You can't tinker with the weighting of something that doesn't exist, and if you don't have the necessary data, no amount of reweighting is going to improve things. Microsoft in this case no longer needs to come up with any data of their own, they can just use clicks on Google as a proxy for any combination of signals.
- zzleeper 16y agoI think there is a DEEP flaw in this argument: "Here’s another one. This time, it’s a misspelling of “bombilate,” a rare word I cited above. I searched for “bombilete,” instead.." In essence, they say that Google only pointed to the typo, but Bing redirected to it. Thus, "it’s very unlikely it figured this out from Google". For me, making that argument is insulting to the readers intelligence.
- jeroen 16y agoYou missed part of the argument: "But it’s very unlikely it figured this out from Google, given that for the misspelling, Google doesn’t auto-correct the word nor provide the same answer." Bing's nr 1 result is not in Google's results at all.
- moultano 16y agoGoogle has the spell correction. Microsoft could certainly be harvesting that data directly. (Which appears to be what they are doing on that query.)
- indyank 16y agoVery true...they might be doing this as part of their "cost cutting" exercises.Hasheem had mentioned this and I am not sure what made him to mention "cost cutting" in that panel discussion where Matt and Blekko CEO participated.
- indyank 16y agoIt is known to all that both use user data in whatever way possible.But what bing seem to be doing it is use it on users searching on google (through IE etc. or maybe even windows) and find the more relevant ones.Did you guys notice Harry Shum mentioning about "cost cutting" in the video where Matt, he and the blekko CEO discuss on this issue. So, it looks like bing is indirectly using google's data by incurring lesser cost and this is how they seem do it.Spy on google searchers and build the right database. instead of spending on innovation and new ways on the algorithm. Let google do that part while we piggy back on their good ones. This is what has really irritated google.
- joelhaus 16y agoI found this very strange... Did Bing increase clickstream data usage in their algorithm when Google saw Bing results get more Google-like in October of 2010 or not? Shrum: Not so, Bing told me. In October, Bing says it rolled out a new ranking algorithm plus a new experimental system called “Aether” that allows them to test changes in their ranking methodology. That’s what caused the bump that Google saw, not some sudden use of the surfstream, Bing said. Web (during October 2010): http://www.google.com/search?q=Bing+new+ranking+algorithm&&tbs=cdr:1,cd_min:10/1/2010,cd_max:10/31/2010 http://www.google.com/search?q=Bing+new+ranking+algorithm...
- treelovinhippie 16y agoRemember when the polarizing search battle was between Google and Yahoo? ...yeah neither do I. These battles do nothing more than establish the two dominate players.