17 ms·

Bing sets the record straight on recent accusations

• trustfundbaby 16y ago
  > Google’s “experiment” was rigged to manipulate Bing search results through a type of attack also known as “click fraud. hunh? > So big and noticeable that we are told Google took notice and began to worry. Then a short time later, here come the honeypot attacks. Is the timing purely coincidence? Are industry discussions about search quality to be ignored? Is this simply a response to the fact that some people in the industry are beginning to ask whether Bing is as good or in some cases better than Google on core web relevance? I can't believe this was written by someone with 'Vice President' in their title ... how childish.
  • vash_stampy 16y ago
    Read google's "Bing Sting" experiment on Google's blog. Their test had no control variable (ie: running the same test on another website that wasn't Google). If they had done their expirement on another site and Bing results didn't change then Google would have a very plausible case against Bing. Google fell into the classic trap of confirmation bias with bad scientific method. And thus the test was 'rigged', they never had a control variable.
    • makmanalp 16y ago
      What would be a suitable control variable? How would one know if Bing is using results from that website too or not?
    • moultano 16y ago
      Their assertion was not "bing is using clicks on google search and only google search." The assertion was just "bing is using clicks on google search." They've demonstrated that pretty conclusively.
      • Splines 16y ago
        You can't decide to reason through induction on one set of variables (all searches, not just "hzzxsqqdga", are copied by Bing) and leave it out on another (click data on all websites, not just Google, are copied by Bing).
        • moultano 16y ago
          I'm not doing that. How did you get that impression?
          • Splines 16y ago
            The phrasing of "bing is using clicks on google search" implies that google search is a single case (I could likewise claim "bing is using clicks on duckduckgo") that does not extend to others. Wouldn't it be more accurate to say that "bing is using click data"? The fact that google.com is in a lot of that click data is a questionable decision and the root cause of all this drama.
            • ac2u 16y ago
              Yes. Why can't people grasp this very simple idea before opening their mouths and spreading this FUD. I see even pg fell for this. The only way the words "Bing copies google" would be justified is if MS were directly querying Google on certain keywords and ripping off search results. Google have provided no evidence to suggest this. I expected the commmenters of Techcrunch to be unable to grasp this, but it seems that HN is often like this too.
              • amalcon 16y ago
                To be fair, I think that claim would be justified if they were "merely" grabbing the Google SERPs their users happen to receive, turning them into ranked lists of URLs, and using that data some way. It would even be justified if they were harvesting click data only from Google (or explicitly treating that click data differently), because then they're just doing the last one, but obfuscating it: it would be like refusing to bribe a politician directly, but instead making a large "investment" in a corporation they own. It's not a justified claim if they built a mechanism that genuinely gathers interesting data, and would continue to do so in Google's absence. I think Microsoft is claiming this, but their responses have been so murky that it's not 100% clear. Google certainly hasn't produced evidence that renders this version implausible.
    • haberman 16y ago
      Your "control variable" only matters if the hypothesis they are trying to prove is "Bing special-cases Google." That is not the hypothesis. The hypothesis is "Bing has results in its index that it could not have gotten in any other way than from Google search results." Their experiment does indeed confirm that hypothesis.
      • vash_stampy 16y ago
        Incorrect, once again to come to that conclusion you would need to test on a site that WASN'T Google as well.
        • Splines 16y ago
          Exactly. They never did any testing designed to specifically not have the result show in Bing.
          • davorak 16y ago
            Which means they do not know the boundaries of their problem. What part of googles argument is countered by it though?
            • Splines 16y ago
              It means that they have falsely arrived at a conclusion due to positive bias. They might be right, but they haven't proven it sufficiently. The inverse of the conclusions of their experiment are also incorrectly assumed (Google results, using IE8/Bing toolbar, make Bing results != Bing results, when using the IE8/Bing toolbar, are from Google).
        • haberman 16y ago
          If your analysis is correct, you should be able to explain a scenario under which, given Google's experiment, Bing's result for "hiybbprqag" came from somewhere other than Google. What is that scenario?
    • scottmp10 16y ago
      My understanding is that running the experiment on some random other sites would work as well as long as Bing user's were actually clicking the honeypot links. This is probably the intended functionality of the click stream data. That doesn't change the fact that using this type of data from competitor search engines results in "stealing" (for lack of a better word) search results, particularly for rare terms such as "tarsorrhaphy".
    • napierzaza 16y ago
      So what exactly would a control that satisfies you be? How about I submit search terms on the computer terminal that connects to a server that isn't even on the internet. There, those searches do not end up affecting Bing. The fact is that they used unique search terms that link to unique subjects. They ONLY submitted searches using what they described. That means the only places those searches passed through were the OS, toolbar, IE and Google. They know Google received those searches, did it propagate to Bing? That's it. They didn't need to offer a placebo to anyone. It's like throwing a ball and hearing an echo. You don't need to NOT throw a ball just to make sure it doesn't echo.
• thankuz 16y ago
  Not only that, there's too many hypothetical, open ended questions - they don't really address anything. Instead they leave it to the reader to imagine. Not impressed.
• moultano 16y ago
  This seems to be mostly ad-hominem arguments in the classic definition of it: "You're wrong because there's something bad about you," rather than addressing any particular point. I don't see how questioning Google's motivations for uncovering this is doing anything to "set the record straight." A useful post would have addressed at least 3 things: - What are the specifics of the mechanism by which they ended up obviously copying google's results? - Do they handle clicks from google differently than any other clicks? - How different would their results be if they didn't use clicks from google's search as a signal?
  • ddemchuk 16y ago
    I wouldn't say it was obvious, mainly because this was something Google did specifically to cause this. I would imagine you could replicate the same results with other major search engines simply by doing the same thing with the same amount of volume as the Google dudes did. Additionally, if things were reversed and Google was posed these questions, I would imagine would be lacking just as many answers as what Bing is supplying.
    • txxxxd 16y ago
      > I wouldn't say it was obvious, mainly because this was something Google did specifically to cause this There is a subtle point that many posts like this are overlooking. Google didn't run this experiment to cause bing to show bogus results, they did it to confirm the rise in suspiciously similar results produced by bing.
      • corin_ 16y ago
        Google didn't run this experiment to cause bing to show bogus results, they did it to confirm... There is a counter argument to that. If Bing's claims are true, then Google didn't run the experiment to confirm the results, they ran it to cause the results. I think 99% of HN, including myself, will share your opinion, but it doesn't counter Bing's claims because it boils down to "which company do we believe?"
• thenonhacker 16y ago
  Google, Google. Stop crying. Just continue copying Bing. Infinite scroll images. And large image backgrounds on the search page. Copy the Maps features, too.
  • Groxx 16y ago
    I boggle that people think infinite scroll came from (X). People have been hacking infinite scroll onto pages that don't support it for years, frequently through Greasemonkey scripts and there are a few very powerful extensions for essentially every browser out there. If you want to claim Google copied it from Bing, Bing copied it from creative users. I highly doubt there has been any significant amount (if any at all) of UI/UX original-creativity on any large website before someone else made a quick demo on their personal site or hacked it on top of existing sites through browsing tools.
• deleted 16y ago
  [deleted]
• Kylekramer 16y ago
  This whole debacle is dragging both companies down. Overstatement and intentionally framing the story by Google, vague answers and changing the topic by Microsoft. Though in the end, Google probably gets a net win cause they got "Microsoft copied us" headlines from some major sources with probably little follow up from the average reader. But the whole situation could have been handled better.
  • georgemcbay 16y ago
    I can't speak for the masses but this is a net lose for Google in my eyes because it paints them as being extremely hypocritical IMO. Keep in mind that we're talking about Google here. The Google of Google News, the web-corpus assisted translation engine, the Google book scanning project, wifi scanning, etc. Not that I'm negative on any of those projects, but based on the amazing degree to which their business piggybacks off the work of others it does make it difficult for me to take them seriously when they come out swinging at somebody else for piggybacking off of them, especially when the piggybacking going on here appears to be fairly minor and incidental.
• bertil 16y ago
  Now that we have confirmation that Bing uses clickstream data on sites that they do not control, I'm surprised that no one mentioned this makes them sensitive to click-fraud. Copying a leader isn’t as objectionable as denying it and I would argue that Google could split their search engine into independent entities—say: crawling, algorithm, interface. That way, competitors could try to outrun them and innovate on one or the other, separately: Firefox, Siri and many others on the interface; Cloudera or Amazon on the crawl, DuckDuckGo and physics labs on the algorithm (just spitballing there). What Bing did wasn’t that different from a grease-monkey script that would supplement bing.com results with Google‘s, it seems — or at least, they could have had the humility to present it that way. Now, their pride made them confess to being easily gamed.
  • gojomo 16y ago
    Do we have any information about whether Google uses clickstream data from users traveling between non-Google sites? As I noted in a previous thread (http://news.ycombinator.com/item?id=2166256 http://news.ycombinator.com/item?id=2166256), Googler Amit Singhal's wording was a bit vague about whether URL trail data from things like the Google Toolbar, Analytics, Ads, or other systems ever affects rankings. (His careful wording, "put any results on Google’s results page", could mean merely that URL trail data never adds results to the set of all possible results. It could still affect rankings of pages found through other crawling.) The use of such data is clearly allowed by Google's very broad privacy policy. I would love a clear answer from Google on this. It should be easy to give.
    • muro 16y ago
      this has been answered many times already - check the other threads.
      • gojomo 16y ago
        If so, please link to a definitive statement addressing this from a Googler. I've been looking and haven't found it.
    • 16y ago
• dooq 16y ago
  Bing is admitting their results are affected by click fraud then??
  • pessimist 16y ago
    Not quite - they are admitting that click fraud on google.com affects their results!
    • beej71 16y ago
      And those of us with our own DNS servers know exactly where google.com is. I wonder how smart the Bing Toolbar really is.
      • Natsu 16y ago
        You probably don't need a DNS server. /etc/hosts should be plenty. Maybe they're smarter than that, and I think they are if you try to mask Microsoft's own domains, but I doubt they check to see if Google.com has been changed, though that could certainly change.
  • ot 16y ago
    Yes, but only on hapax legomena :)
• axiom 16y ago
  From the Google blog post: "This [torsorophy] example opened our eyes, and over the next few months we noticed that URLs from Google search results would later appear in Bing with increasing frequency for all kinds of queries: popular queries, rare or unusual queries and misspelled queries. Even search results that we would consider mistakes of our algorithms started showing up on Bing." That's the key. Not the honeypot. The honeypot was just a test to see if they could catch them red handed. Bottom line is that Google looked at the statistics and found that Bing results were improbably similar to Google results. Maybe they're lying about this, but I doubt it. There's not enough information to figure out exactly to what extent Google impacts Bing results, but I would bet a lot of money that in the Bing code base there is Google specific code that behaves along the lines of "if on google, do x" rather than some generic code that just targets all sites.
  • HardyLeung 16y ago
    I'd play devil's advocate here and say that I give Bing a slight benefit of the doubt. Given they cannot perform a parallel Google search on every single user query (this would have been easiest to spot), the technique cannot be of the form "if on google, do x". Rather, it is likely they look at what users search and what results they get as one of the parameters, say normally influencing 0.2% of the search ordering on average (assuming 500 "signals"). In the case of "torsorophy", out of the 500 "signals" only one came up, the Google result (via Bing toolbar from a few users). So, their algorithm makes a note of that, like, hmm... I don't really have anything else so I'd just rehash what users have searched and subsequently visited. So the 0.2% becomes 100%, and internally Bing associates the word "torsorophy" with that website. Next time "torsorophy" is searched it returns that site. Yes, Bing is likely using Google's data (if available, via Bing toolbar) as part of the ingredients. You can argue whether this is stealing or not, whether this is Google results or user search/visit behavior, and but I would say it isn't exactly "if on google, do x".
    • Terretta 16y ago
      > "the technique cannot be of the form 'if on google, do x' ... Rather, it is likely they look at what users search and what results they get" How do they look at what a user searches and what result they get? Ok, the "click stream" can see what pages a user visits. But to get the search term, they are parsing something, and unless they implemented a universal search recognizer that will rank up results from any old site's search (allowing 20 SEO guys to push private SERPs to the top), it seems more than probable the parser indeed would start with "if on google, do x".
• deleted 16y ago
  [deleted]
• cryptoz 16y ago
  > We have been clear about this for a couple of years (see Directions on Microsoft report, June 15, 2009). That's about as unclear as anyone can be. Seriously Microsoft, this is the Web. When you want to point your readers to a document, don't fucking cite it like some printed academic paper! LINK TO IT.
  • pygy_ 16y ago
    It was published on Direction on Microsoft[1], which is supposed to be an "Independant Analysis of Microsoft Technology & Strategy". The yearly subscription is $1500. If [2] can be transposed, non-subscribers can also get the report for a whopping $750. I couldn't find that report in their archive,though. The only article published on june 15 2009 is [3], which is unrelated. [1] https://www.directionsonmicrosoft.com/ https://www.directionsonmicrosoft.com/ [2] http://www.reuters.com/article/2009/04/21/idUS223966+21-Apr-2009+PRN20090421 http://www.reuters.com/article/2009/04/21/idUS223966+21-Apr-... : [3] http://www.directionsonmicrosoft.com/update/50-june-2009/678-hyper-v-r2-gains-live-migration.html http://www.directionsonmicrosoft.com/update/50-june-2009/678...
• fady 16y ago
  after reading the first few paragraphs, i closed the tab.. a waste of space. all PR crap.
• brudgers 16y ago
  Whether it was a type of attack also known as “click fraud,” or not, it does appear to be an attack. One can argue that the attack was justified - and one can argue that it's not - but it still was a deliberate effort to improve page rank in a way similar to one which Google actively discourages. The fact that only 7/100 of the honeypots were successful may mean that Google's motives may have been more complex and slightly less akin to righteous indignation - such as determining how and to what degree Bing handles "click fraud" type attacks. I just have a hard time believing that Google would turn 20 engineers loose on a task that can be so easily automated.
  • rflrob 16y ago
    >Whether it was a type of attack also known as “click fraud,” or not, it does appear to be an attack. I disagree with describing this as an attack. Based on the kinds of search terms Google has said they used, they aren't attempting to make the Bing results any worse. There is simply no good search result for "hiybbprqag", so Google pointing to the Wiltern Seating Chart is just as good as pointing to nothing at all from the purposes of what any user who happened to Google hiybbprqag randomly would see. At best, you could make the argument that by revealing that Bing is susceptible to these kinds of attacks, they are making it easier for others to attack Bing. It's certainly illegal to rob a bank, but what about walking down the street yelling, "The bank guards are all gone! The combination to the vault is 1-2-3-4-5!"
    • brudgers 16y ago
      "what any user who happened to Google hiybbprqag randomly" But it wasn't any user, it was a Google engineer and the circumstances were not ordinary. Those engineers were actively trying to get the results into Bing over the course of at least two weeks 12/17-12/31 according to searchenginland.com.
      • rflrob 16y ago
        So Google, by doing this, has created up to a hundred or so bogus entries in the Bing database, to which I say, "big whoop". If Google had to pay damages for the extra infrastructure that Microsoft requires, the stamp to mail the check would be more than the check itself. What I would classify as an attack is if, through a similar process, Google introduced bogus entries for real search terms, which they don't claim to have done.
• trunnell 16y ago
  I have a much lower opinion of the Bing team after reading this non-denial denial. It's disingenuous to act surprised that using clickstream data from your main competitor might be called copying.
  • hackinthebochs 16y ago
    And I have much lower opinion of the Google team (and they had much further to fall). They intentionally use ambiguous and loaded words like "copying" specifically to stir up drama. Google is smart enough to use precise words when they want, and not to when they want. The ambiguity was intentional.
    • moultano 16y ago
      I don't think it's ambiguous. They are contending that bing is intentionally using this to recreate results similar to google's. I'm guessing you feel this is ambiguous because you don't think it is supported by the data, not because they are saying anything unclear.
      • hackinthebochs 16y ago
        Characterizing it as "copying" is what's ambiguous. This can easily be seen by reading most discussions about this. People are arguing past each other, armed with their own personal definition of "copying". The facts are that make-believe search results showed up on Bing after Google intentionally tried to train Bing to pick up the association. Declaring this to be "copying" is begging the question.
        • Natsu 16y ago
          > The facts are that make-believe search results showed up on Bing after Google intentionally tried to train Bing to pick up the association. Declaring this to be "copying" is begging the question. Well, it was trained by having the Bing toolbar see people clicking those results on Google's search engine. But I do think you're right that people are talking past each other and what outrages one person could very well be something that another simply doesn't care about.
• bhavin 16y ago
  One difference between Google's vs MS's approach. While Google's first post was much more rational (with proofs) and convincing to tech minds, this post seems more a politician's attack on Google with vague and scary sounding words like "click fraud". Only if some evidence for the above "click fraud" were supplied!!
• draz 16y ago
  First, I have friends working for Microsoft as well as Google. I like and hate both companies, for different reasons. Now, to the meat of what I wanted to get to: "We have brought a number of things to market that we are very proud of -- our daily home page photos, infinite scroll in image search, great travel and shopping experiences, a new and more useful visual approach to search, and partnerships..." Seriously?? Are you going to put "daily home page photos" as (first!) point to be proud of? Is it such a technological feat? Kudos for the rest of the items, but I just found it funny
• jmaygarden 16y ago
  The first comment to the blog post is humorous. Bing, "Powered by Google". It does have a nice ring to it.
  • deno 16y ago
    Another, quite tongue-in-cheek, humorous app found in comments: http://createasearchengine.appspot.com/ http://createasearchengine.appspot.com/
    • zzleeper 16y ago
      That's a nice one!!! Over 1000 thousand!
• tristanperry 16y ago
  >> "As we have said before and again in this post, we use click stream optionally provided by consumers in an anonymous fashion as one of 1,000 signals to try and determine whether a site might make sense to be in our index." Erm, the Google test took pretty non-sensical keywords and put at #1 some completely unrelated website. And then Bing copied this unrelated website result from Google. The above quote from Bing (especially the bit in italics) is therefore a little confusing. Since, again, the entire point here is that Bing shown completely unrelated websites taking straight from Google. The results weren't relevant. Thus making the quote fairly contradictory in my opinion. Yet another 'reply' by Bing, and yet again they seem to be trying to insult their way out of it via ad hominem and strawman arguments. And yet again, Bing still haven't addressed the key point here: why Google results were taken and used by Bing.
  • zepolen 16y ago
    Bing sees that I searched for a term, 'iwejhoihfe' on google and ended up clicking a link to foobar.com/page there, this gives foobar.com/page a relevance with the term 'iwejhoihfe'. Since the 'iwejhoihfe' doesn't show up anywhere else on the web, that single relevant site gains a lot of weight for that term. This is how Bing's algorithm may have worked, and I wouldn't call it intentionally copying, flawed maybe and easily manipulated just like Google Bombing in the old days.
• hexis 16y ago
  Bing seems to want me to sign in to read this. Am I doing something wrong?
• jpwagner 16y ago
  Great response. I wouldn't have used the term "click fraud," but the analogy is easy to grasp (ie, that the "test" purposely attempts to strengthen an association between things that are not associated.)
  • lysium 16y ago
    How is that a great response? It does not address the allegations at all, just claims the allegations are insulting. The only great thing I see is that the blog post actually confirms what Google said. Because otherwise, it would have been easy for Microsoft to put the finger at the point where Google is wrong.
    • jpwagner 16y ago
      I think this response is convincing. Period. Full stop.
      • jongraehl 16y ago
        Why would anyone upvote a completely ambiguous comment (what is "this response")? You thought the ambiguity was intentional?
        • jpwagner 16y ago
          Were you also confused by the previous comment when it asked "How is that a great response?"
          • memetichazard 16y ago
            "How is that" clearly refers to Bing's response. I'll admit that I interpreted your post "I think this response is convincing" as referring to lysium's response to your post. It may have been clearer if you had written 'the response', or more directly, 'Microsoft/Bing's response'.
            • 16y ago
• blauwbilgorgel 16y ago
  From a logical debating point of view, this post is really weak. If I were an engineer at Google, and I caught Bing at this, I would be upset, to the point I couldn't sleep. This is one of the lowest things you can do in academia, and even though this is business, the accomplishments of the engineering team at Google is at the highest point of information technology. As a businessman I could have taken this, not as a hacker/problem solver. "It was interesting to watch the level of protest and feigned outrage from Google. One wonders what brought them to a place where they would level these kinds of accusations." Feigned outrage... one wonders... If you really not understand this, you are not a hacker, you are not an engineer. Maybe it was your actions that prompted two valued Google engineers (Singhal and Cutts) to make these accusations? "Before we explore that (so you gonna prove this point later on?), let me clear up a few things once and for all. We do not copy results from any of our competitors. Period. Full stop." The end result is a copy of the results of a competitor. If you borrow it, steal it from your users, copy it from a guy in a raincoat with binoculars, observing Google results and jotting them down -- It doesn't matter! OK, let's say you don't copy results. Your index still contains copied results for a fact. "We have some of the best minds in the world at work on search quality and relevance, and for a competitor to accuse any one of these people of such activity is just insulting." Bing copied Google's fake results. Your engineers either deliberately or accidentally made Bing copy those results. If you want less insulting: Google claims your minds are the best at copying others. " We do look at anonymous click stream data as one of more than a thousand inputs into our ranking algorithm. We learn from our customers as they traverse the web, a common practice in helping to improve a wide array of online services. We have been clear about this for a couple of years (see Directions on Microsoft report, June 15, 2009). " That will make me trust your index a lot less. If engineers clicking manually on some results can make a difference in ranking, imagine what a botnet or dedicated spammer can do. " Google engaged in a “honeypot” attack to trick Bing. In simple terms, Google’s “experiment” was rigged to manipulate Bing search results through a type of attack also known as “click fraud.” That’s right, the same type of attack employed by spammers on the web to trick consumers and produce bogus search results. What does all this cloak and dagger click fraud prove? Nothing anyone in the industry doesn’t already know. As we have said before and again in this post, we use click stream optionally provided by consumers in an anonymous fashion as one of 1,000 signals to try and determine whether a site might make sense to be in our index. " Ad hominems: Honeypot, trick, quotes:experiment, rigged, manipulate, attack, click fraud, attack, spammers, trick consumers, bogus, cloak dagger, click fraud, prove? nothing. If you need those words in a paragraph to describe how you got caught with your hand in the cookie jar, then you already lost. " Now let’s move the conversation to what might really be going on behind the scenes. " Yes, move the conversation away from your duplicate results, the key issue at hand. " Bing was launched nearly two years ago .to break new ground and help move the search industry in new directions. We have brought a number of things to market that we are very proud of -- our daily home page photos, infinite scroll in image search, great travel and shopping experiences, a new and more useful visual approach to search, and partnerships with key leaders like Facebook and Twitter. If you are keeping tabs, you will notice Google has “copied” a few of these. Whether they have done it well we leave to customers. But more importantly, we take no issue and are glad we could help move the industry to adopt some good ideas. " copies marketing paragraph. Rebuttal: Google didn't use its toolbar to "copy" your pictures and add those to their own background. " At the same time, we have been making steady, quiet progress on core search relevance. In October 2010 we released a series of big, noticeable improvements to Bing’s relevance. So big and noticeable that we are told Google took notice and began to worry. Then a short time later, here come the honeypot attacks. Is the timing purely coincidence? Are industry discussions about search quality to be ignored? Is this simply a response to the fact that some people in the industry are beginning to ask whether Bing is as good or in some cases better than Google on core web relevance? " Bing is absolutely horrible for international searches. You serve up 40 different language Wikipedia pages for some terms. But you are saying, that Google deliberately timed your outings? That is like saying your brother saw you stealing cookies, but waited till he got a bad report card, before telling mom. And I thought a bruised academic ego was childish. So your rebutal amounts to: But mom! He got a bad report card! And that while you are struggling making your grades yourself. " Clearly that’s a question that will continue in heated debate as long as there is a search industry. Here at Bing we will continue to focus on our customers, and try to provide some great innovation for consumers and the industry. " That's not the question and certainly not core to this case, which is your duplicate index. This is unprecedented in 10 years of search engine competition, and you want to make it about the timing? Let's make it about the 1000 ranking factors vs. the 200 ranking factor from Google. Lets make it about the million other results this could be happening for, but are impossible to prove with a "honeypot attack" and specific keyword? Lets make it about search relevance, how we are spoiled with relevant results, yet complain about the most relevant index on the web, one you use to calibrate long tail terms and spelling corrections?
• nigelsampson 16y ago
  What I'm interested in, does the Google Toolbar send back the click stream when you use Bing?
  • noibl 16y ago
    Feel like experimenting?
• yalogin 16y ago
  Going by what MS says, its clear why Google's experiment worked. They came up with very unusual queries for which by definition there will be no data to generate search results. So out of the 1000 inputs only the one input from Google is present and hence the output.
  • blauwbilgorgel 16y ago
    Yes, but then this also means that for every term in Bing's index, "how it ranks on Google" is 1 of the 1000 factors. It takes a very obscure term to show it, but we shouldn't conclude from that, it happens only for obscure terms. BING!! uses GoogleRank as a ranking factor. Perhaps they even adjust the weights of this factor, according to what the press/blogosphere is writing about Google's index quality...
• lysium 16y ago
  This is the usual FUD we are used to from Microsoft. First just claim that the allegations are wrong (use 'Period.' and 'Full Stop.'). Don't try to explain! Than redirect allegations as a personal attack (say it is 'insulting'). Don't try to explain why, either! Refer to a document that requires paid membership, so only very few people if any can check (don't use a direct link). Gives you cheap credibility. Claim that the experiment is fraud, although no one benefits financially. Don't back up the claim with data. Counterclaim that your competitor is actually copying from you, ignoring the difference between ideas and data. Now that the reader envisions you as the poor underdog that is insulted, is a fraud victim, and is copied, spread the doubt that Google is doing this because it starts to 'worry' (pose an open question like 'is it a coincidence'?). End with the pose that your are not affected by this and concentrate on your business. Never, ever answer the allegations with a simple explanation on why Bing shows bogus results because some Google employees search while the Bing Toolbar was active. {Overlook that you admitted that your are prone to click fraud.}
  • billybob 16y ago
    Thank you for summing up why posts like this one from MS make me queasy. Lots of spin and posturing and insinuation when a clear, technical answer is needed. It's like, "Son, did you steal those cookies?" "Mom, Justin always accuses me of stealing cookies, and I've been getting good grades lately, and last week Justin hit me for no reason, and don't you think he should be in trouble too?" Answer the question, son.
• lysium 16y ago
  The post indirectly confirms Google's claims. Otherwise, it would have been easy for Microsoft to point out where Google is wrong and everybody would blame Google for being stupid. Instead, Microsoft chose to attack Google 'personally' with non-substantiated claims.
• BoppreH 16y ago
  "anonymous click stream data" It can't be only that. The page where the clicks happen must be parsed for the click be linked to the query and reused at their search engine. They transformed: "from google.com/q=X, people tend to click on example.com" Into: "when searching for X, people tend to click on example.com"
  • andyv 16y ago
    They not only parsed the search queries, they also copied Google's results and added it to their own results.
    • BoppreH 16y ago
      Monitoring the clicks and parsing the data should be enough to account for the results we see.
• skarayan 16y ago
  It would be interesting to compare the search results of a million or so keywords between Google and Bing using their APIs. I would like to see some numbers behind the overlap.
• deleted 16y ago
  [deleted]
• thought_alarm 16y ago
  This is the record: Searching for "torsorophy" on Google brings up the Wikipedia page for Tarsorrhaphy because of Google's advanced spelling and error correction algorithms. Searching for "torsorophy" on Bing will (or used to) bring up the Wikipedia page for Tarsorrhaphy because of Google's advanced spelling and error correction algorithms, because Bing watches how people use Google. Two different kinds of innovation at play, one much more legitimate and impressive than the other. But it's not like Microsoft is in unfamiliar territory here.
  • kenjackson 16y ago
    So does "fast forier twansform" -- did Google honeypot that term too? Or the other 20 terms I just tried with arbitrary mispellings?
    • true_religion 16y ago
      When Bing adjusts the results it shows due to user click-ranking, it does so without any notification. That's because its a ranking issue. When Bing adjusts the results as due to a spellcheck done by their engine, it notifies the user so they can correct it. On your example, Bing search does exactly this: > We're including results for fast fourier transform. Do you want results only for fast forier twansform?
      • kenjackson 16y ago
        I completely agree, but to quote the person I was replying to: "Searching for "torsorophy" on Google brings up the Wikipedia page for Tarsorrhaphy because of Google's advanced spelling and error correction algorithms." Both companies have good algorithms for spelling and error correction, but neither appears to be a superset of the other. (For example, Bing corrects "Kransas" to "Kansas", but Google does not). I was addressing the fact that Bing has at its disposal some advanced techniques too. It's not just Google that does. And I illustrated this by pointing out that there are a lot of queries that do the spell correction on Bing that obviously weren't honeypotted -- as seemed to be implied by the original comment.
• bluelu 16y ago
  All I can say is, that google engineers must be really jealous for not coming up with the same idea of ranking sites based on what people enter into search boxes and what links they click on. Sounds like Pagerank 2.0 to me.
  • blauwbilgorgel 16y ago
    There were AI algorithms in 1999 that described doing exactly this. Pagerank is perfect for the web. Agreed, tracking people like ants, the links they click on as pheromone trails, makes for a great program: 90% of users visiting website A about pancakes, went to site B about pancake recipes. The problem lies in tracking your users to this extend. On the web this isn't possible, unless you control vast web estate and are unscrupulous about using this data. I bet most Google engineers know about swarm intelligence computing, and aren't jealous at engineers like: http://www.youtube.com/watch?v=7GM4Lt5k24s http://www.youtube.com/watch?v=7GM4Lt5k24s who don't Bing! loud enough.
  • slig 16y ago
    Yes, but from what other relevant search engine would them copy that? ps: FYI, Google does record the clickstream within their own search results.
• bmccormack 16y ago
  Regardless of whether or not one agrees with Yusuf Mehdi's conclusions, I can certainly understand his passion in defending his team. Google's accusations yesterday were very accusatory and polemic (e.g. "We look forward to competing with genuinely new search algorithms out there—algorithms built on core innovation, and not on recycled search results from a competitor. " ouch).
• naner 16y ago
  Just once it would be great if tech companies could lay off the hyperbole and posturing and just give it to us straight. Bing copying Google? Not really. Honeypot attack? Give me a break. Here's what appears to be the truth: The Bing toolbar keeps track of what people click on after doing a search. Even when it is from sites that aren't Bing. If it is a search for something obscure (or made up) that Bing has no other data for, then that clickstream data can affect Bing results for that term. Most of the time, however, that is just one of thousands of inputs. It is useful data, but not a defining part of the Bing engine. This was obviously a huge PR move on Google's part. The information was released to a massive search engine blog right before a big search engine event with both Google and Bing in attendance. Bing could have come out of this shooting straight and looking like the more mature party, instead the come across like they are unsure of themselves and have been backed into a corner. Score one for the bullshit artists at Google.
• gvb 16y ago
  One really interesting thing about Bing watching google searches and changing their page ranking based on users clicking links... it implies one way to "SEO" (game) Bing page ranking would be to use Amazon Mechanical Turk to raise a page's rank on Bing by having lots of Mechanical Turks doing google searches and click-throughs on the target page. It would be interesting experiment to estimate how heavily weighted the clicking is vs. the other 999 inputs. I would think a very obscure page would be fairly easily manipulated (Google basically showed that with their "honeypot"), but a more popular page with lots of non-zero entries in the other 999 inputs would be a lot harder to game.
• contextfree 16y ago
  Apart from his flustered tone, Mehdi said nothing that Harry Shum didn't say in his post yesterday. I don't know why he bothered posting this.
• InclinedPlane 16y ago
  Here's the problem in a nutshell: The Bing toolbar uses clickstream data to extract information about the relatedness of urls, just like any search engine crawler does (page rank works this way). When a user clicks on url B from url A the Bing toolbar sends information back to MS about the relatedness of urls A and B including all the meta-data involved. If url A is ".../search?q=torsorophy" then Bing will make a note of that and will start showing results for B when you search for "torsorophy". In principle this isn't necessarily a bad thing, it allows Bing to index sites that it wouldn't otherwise, letting its search index grow more organically. However, when search engines come into play things get problematic, because now the Bing toolbar is little more than an automated method for scraping search results piecemeal. Given that a great deal of modern web surfing falls into the "search for X, click links for X" pattern, this should have been something that the Bing engineers anticipated (if they didn't anticipate it that's bad enough, if they did and ignored the problem that's much worse). Worse yet, the Bing toolbar is effectively a search indexer which does not respect robots.txt. Let that sink in for a while. Google.com/robots.txt has this line: "Disallow: /search", and yet apparently the Bing toolbar has absolutely no compunction about effectively ignoring that. tl;dr: MS has created a search indexer which ignores robots.txt, this is bad.
  • recoiledsnake 16y ago
    Err, robots.txt doesn't even enter into the picture. It would matter only if Bing's server was requesting pages off Google's site. That is not happening. The only things that are going are the Google URL and only the clicked URL(not the other Google results that the user didn't click on). The user gave permission to Microsoft to use this info by installing the toolbar. I don't see why or how the Bing tool bar should visit Google.com/robots.txt to see the blocked folders unless they were crawling Google pages.
    • zzleeper 16y ago
      But it's the perfect way to circumvent robots.txt! With enough users the law of large numbers applies (and how many hundreds of millions of users are using IE?) so you can a.s. copy Google's index. In particular, you copy the most popular results, so if you weight the % of google's index that you copied, then it's going to be a huge number, and almost for free. It's evil. But devilishly smart.
• ecaron 16y ago
  Article appears to be down, fortunately you can still access it from Google's cache: http://webcache.googleusercontent.com/search?q=cache:www.bing.com/community/site_blogs/b/search/archive/2011/02/02/setting-the-record-straight.aspx http://webcache.googleusercontent.com/search?q=cache:www.bin...
• bluesnowmonkey 16y ago
  Why are people suddenly using the word "honeypot"? A honeypot is something intended to be broken into. Nobody broke into anything in this story. There were no honeypots involved. You might call the search terms "tracers" or something. Another thing that did not occur is click fraud. That term already means something, it involves pay-per-click advertising, and it doesn't have much to do with Google's experiment. Don't let this guy distort the language we use to discuss the issue.
• sonoffett 16y ago
  I mentioned this in another article, but I have yet to see evidence that demonstrates that bing is parsing google's queries either from a) the url of the referrer, or b) directly on the google results page, yet many people on HN have asserted as such, generally exhibiting a false dilemma fallacy. An alternative is that the bing toolbar is collecting 2-tuples "<search_string_in_toolbar, next_href_clicked>" and sending these back to microsoft (regardless of the search provider selected). I would consider this "click stream data" and seems to agree with statements in the above article. Additionally, since it doesn't involve parsing hrefs it seems like the easier solution (and the one I'm going to tentatively assume by Occam's razor). Just to be clear, it does not have to be the case that the bing toolbar is collecting data entered directly into the google search box. Indeed, google could have tested for this by having a control group where they entered search queries without using the toolbar search box, however from the details released so far we cannot conclude they did this (read: google hasn't released enough specifics about the test they conducted, and it's far from being reproducible with the current details). Additionally, why do many in the HN community think this google specific? I understand that google isn't claiming "bing copied just google" but that seems to be the consensus within HN and the arguments of foul play (see the countless posts asking if there exists code that specifies google: "if string contains 'google' then..."). I'd like to see a test where users entered a pathological string in the toolbar with an alternative search provider specified (EDIT: not bing or google), clicked on a low ranking result (low ranking, or not appearing at all on bing for those keywords), and see if it pops up higher on bing at a later time.
• jeisc 16y ago
  'Imitation is the sincerest form of flattery.' But, 'Flattery is the worst and falsest way of showing our esteem.' Jonathan Swift
• lazugod 16y ago
  It isn't clear whether Bing was taking special interest in click data off of Google searches, or giving it special weight in its own results. Google seemed to think so, but even if Microsoft was treating the data they received as neutrally as possible, it doesn't change the request made of them. Google wants an exemption.
• 425 16y ago
  To me, it seems quite simple. Someone at Google used Bing toolbar and IE8 in following way: a) Search from Bing toolbar for hiybbprqag. b) Bing does not display anything. c) Bing toolbar remembers that term internally. d) Go to www.google.com and type hiybbprqag. e) Google displays one intentionally seeded link. f) Google engineer click on that link. g) Bing toolbar notices that shortly after user searched for hiybbprqag, s/he clicked on seeded link. h) Bing toolbar sends that piece of that to mothership: There is relationship between hiybbprqag and seeded link. ... i) After some time, Google engineer searches for hiybbprqag from Bing toolbar. j) Bing looks up its index and there only one piece of evidence regarding term 'hiybbprqag'. It is not much, but it is all it has, so it presents it to the user. Google accusations strongly imply (using words like 'stealing') that Bing simply scraps google.com for results, while reality is not so simple. Now, bigger Microsoft problem is that it employs VPs like Yusuf, who cannot express simple facts and easily fall into corporate speak. UPDATE: Here is good summary of what I wanted to say: http://directmatchmedia.com/google-proves-bing.php http://directmatchmedia.com/google-proves-bing.php
• motters 16y ago
  This doesn't seem like a terribly convincing response from Bing. The "honeypot" test seems like a pretty conclusive result to me.
• ItsBilly 16y ago
  The article is titled "Setting the record straight", but it is not fair to say that "Bing sets the record straight"