18 ms·
Company withdrawing from Facebook as analytics show 80% of ad clicks from bots
- treelovinhippie 14y agoMake claims, get more likes.
- spaghetti 14y agoCould FB do something like this to detect click fraud/misbehavior: FB's ad system only counts a click as valid and charges the advertiser when the browser from which the click originated has js enabled. OP says only 1-2% of users have js disabled hence FB would only miss out on a relatively small amount of ad revenue instead of massively over-charging.
- patrickmclaren 14y agoHas anyone else analyzed their referrals and also seen a significant proportion of bots?
- alanfang 14y agoI've run a significant amount of traffic with Facebook Ads and never saw click fraud anywhere close to these kinds of numbers. By estimates it was somewhere between 3-5%, which is pretty typical across major ad networks. It's also worth noting that Facebook has given refunds for click fraud in the past. That is if you can actually get a hold of someone in support who will talk to you, which isn't easy.
- nekitamo 14y agoYes but only in certain US demographics. Most of these bots are ad scrapers/landing page scrapers run by people gathering and stealing the ads/landing pages of their competition. Facebook has known about the problem for a while (years), and have gone so far as to ban some accounts that the scrapers were running out of, but lately it seems the scrapers have been given free reign. This is not a case of Facebook using bots to deliberately drive up ad spending. It's merely scummy internet marketers at work, with Facebook failing to detect and prevent them. The phenomenon is mostly present in the US 18-30 male demographic (where all the dating ads are, and where creatives can make or break you).
- veyron 14y ago"We built a page logger. Any time a page was loaded, we'd keep track of it. You know what we found? The 80% of clicks we were paying for were from bots." How do you tell if it's a bot? Just by user-agent string or repeated slamming by IP address, or is there some other technique?
- vladd 14y agoThe main technique is to notice a pattern that is only explainable by bot activity. Generally speaking, in addition to the patterns you mentioned (invalid user-agent strings, rapid succession of same-IP access) there are also other patterns, such as failure to load referenced CSS or image files, or 100% failure on Captcha challenges.
- veyron 14y ago"failure to load referenced CSS or image files" -- is there a way for bots (in particular, mechanize in perl/python) to also download those files? "100% failure on Captcha challenges" -- are captchas generally deployed on click-through ads?
- mootothemax 14y ago"failure to load referenced CSS or image files" -- is there a way for bots (in particular, mechanize in perl/python) to also download those files? Very much so, after all your browser does without you having to tell it to do so. It all depends on whether the hassle is worth it for the bot writer.
- loumf 14y agoOf course they could -- all they need to do is parse the HTML, look for the img and link and other tags, and then request the URL. If they were trying to act more like a browser, they would. If they are just trying to click ads, they wouldn't.
- vladd 14y ago> "100% failure on Captcha challenges" -- are captchas generally deployed on click-through ads? Cloudflare has a mode (used in general for DDOS protection) which you can turn on and get stats on how many users pass a Captcha test.
- j45 14y agoWow, even if this is a little true the implications are big. Is this similar, or related to other ad space inflation? I'm reminded of Google (and others)(1) sending out free $75 adwords coupons to easily allow the costs of bids to inflate since it's not my own real money (thereby increasing the percentage of real cash being made on the ads)? (1)Edited and clarified
- nolok 14y agoHow come, everytime some company does (or seems to be doing) something shady, there is always a bunch of people like this saying "not as bad as Y doing something else that might or might not be true or related". This is not middle school anymore, pointing the finger at other kids is not proper discussion ...
- aggronn 14y agoRaising awareness isn't necessarily bad, even though its off topic.
- user49598 14y agoBecause unfortunately logical reasoning and argument construction are not educational targets for most people. :(
- j45 14y agoIf genuinely curious: I'm drawing a direct comparison of the potential inflation of ad costs in one playground (google) with another (facebook) through both common and unique means. Another common issue to both is click fraud and it's effects on the said cost of ads. My mistake for assuming this was obvious and known. The relevance of such a comparison? It's not a one off, as uncommon as we think. Has nothing to do with pointing fingers. Didn't mean to come across as off topic. To me, if someone upstream and in the past was doing this, chances are it might happen later in time downstream too, and there might be something to see in the forest instead of pointing at one tree or another.
- hessenwolf 14y agoYou make a valid point.
- joshaidan 14y agoI wish their post was a bit more technical. Show us the code you used to detect javascript, how did the analytics work? Did they test their code by using their own browser to click an ad and see if the code detected javascript, or their hit in the analytic software? More technical info and data would be nice!
- tsycho 14y agoWhile that would have been interesting to me as well, I think the post was meant for their actual users, to explain why they are moving away from FB. Technical details would have been an unnecessary distraction for their intended audience. Maybe if they have any employees who follow HN, someone would share more light on the technicals?
- joshaidan 14y agoFound this TechCrunch article that goes a bit more indepth. http://techcrunch.com/2012/07/30/startup-claims-80-of-its-facebook-ad-clicks-are-coming-from-bots/ http://techcrunch.com/2012/07/30/startup-claims-80-of-its-fa...
- sanxiyn 14y agoI didn't know Facebook charges businesses for changing the name of Facebook Page. Is this a well known fact?
- imrehg 14y agoAccording to the FAQ, one cannot change the name of the page once it is set. This can be a real problem that I run into quite a few times, even with a couple of small pages, and even more as every website that has "like this page on facebook" has an automatic facebook page, where the name is determined by them, automatically, once, by the <title> element at that time. Talk about stupid. Anyways, I don't mind since I'm a small fish, but the longer this goes on, the more it will (hopefully, i might say) blow up into their face(book).
- tomrod 14y agoWhy not open a new page, and delete all content (but a link to the new page) off the old page?
- russtrpkovski 14y agoYou lose all your Likes.
- RobotCaleb 14y agoOh no!
- smackfu 14y agoWhich is presumably why this is a policy in the first place...
- russtrpkovski 14y agoFacebook allows advertisers to target friends of users who liked your page. They probably restrict name changes so users associated with a page don't get blind-sided if the company radically changes its product or service.
- gllen 14y agoWhat benefit could a 3rd party conceivably get out of faking clicks on Facebook ads? Is there a rev share at all with publishers, like with adsense?
- WillyF 14y agoDriving up costs for competitors?
- sulife 14y agoTons! Charge their competitors to run out of budget and/or give up advertising on FB. A lot of people also have bots to see who/what is advertising on FB to see what is working, what ad text people are trying, etc. Mostly aff marketers trying to stay ahead of the game. There are also SaaS companies scraping ads and landing pages and selling that data. I'm sure there are other reasons as well...
- JonnieCache 14y ago>But let's move on, because who the bots belong to isn't provable. I'd love to see someone try and find out though. Any IP doing automated requests of that nature is fair game for a bit of probing IMO.
- unreal37 14y agoTake this with a grain of salt. The "company" has 400 likes. Not exactly GM leaving Facebook (and then quietly returning to Facebook).
- vegardx 14y agoThey are talking about ads, not "likes".
- muyuu 14y agoI think he didn't imply that. Obviously a company with 400 likes is not a big player in the Facebook ad space, it was just a measure of popularity. Obviously the news here is not the loss of business for Facebook, but the fact that a click scam was taking place (if true).
- vegardx 14y agoBecause they are not related. You can use them just as you would with Google Adsense. Obviously you can get a lot of free advertisement and edorsement with having people "like" you on Facebook, but that is beside of the point. And the click scam, if true, will take away the only way for Facebook to monetize the product. Marketers are not stupid, things like this spread like wildfire.
- crazygringo 14y agoI don't see what their number of likes has to do with bots clicking on their ads. If true, Facebook should really have anti-fraud measures in place for this kind of thing already, and if they don't, the size of the company in question has no relevance to that.
- timaelliott 14y agoFacebook is relatively new to the advertising game and probably doesn't have the sort of experience that Google, MSN and Yahoo have in dealing with the immense amount of click fraud out there. Worked 3 years in online advertising, dealing with billions of impressions and millions of clicks daily. 80% fraud rate isn't unsurprising, probably is actually higher. Most mature ad networks can easily filter and reject a substantial portion of the fraud, or at least not bill the client for it.
- ecrotty 14y agoThe other thing to keep in mind is if their page has any "accelerated fans" (read : purchased bot page likes), any time they promote a post, they would be promoting to the same bots that liked the page in the first place. No accusations, but, just food for thought.
- alex_c 14y agoI don't really know how purchased page likes work, but why would that matter? Bots / fake accounts used to generate likes have no reason to keep running and click on ads?
- sk5t 14y agoWe dropped the Google Display Network about a year back out of very heavy suspicion of bot malfeasance... lots of clicks from frivolous, consumer-oriented, no-name sites with obviously nothing to do with our somewhat technical, LDAP-focused product.
- nemesisj 14y agoYeah, I'm convinced it's setup to scam users and there's a lot of click fraud happening. Wrote a post about it here: http://peebs.org/148437517 http://peebs.org/148437517
- loumf 14y agoCould it just be a badly written search spider? The ad is simply an anchor tag around an image. If you didn't filter it out specifically, you would just "click" it to get to another page.
- angry-hacker 14y agoI was thinking about it too... but then again why don't we hear the same complain from other advertisers?
- thlt 14y agoI didn't write an own analytic program but can confirm that 80% of clicks from my Facebook ads don't show up on my GoSquared dashboard.
- saurik 14y agoWhen you build an advertisement network, you end up spending a bunch of time figuring out how to isolate these fake clicks and verify that they are not real. As an example, the IP addresses running the bots are going to be clicking "way too many ads to be a human".
- tectonic 14y agoPossibly, but aren't these ads only shown to logged in users?
- wildmXranat 14y agoIf FB is not smart enough to discern curl/wget/whatever_crawler_socket_call used from genuine in browser click then the argument is already won. Hell, you could write an army of Selenium Firefox/Chrome bots to drive up costs of ad competitors, randomise the host machines, etc... but it's still hard to believe that FB anti fraud measures can't figure it out. To me, something is off, whether with FB or these guys.
- wildmXranat 14y agoIf FB is not smart enough to discern curl/wget/whatever_crawler_socket_call used from genuine in browser click then the argument is already won. Hell, you could write an army of Selenium Firefox/Chrome bots to drive up costs of ad competitors, randomise the host machines, etc... but it's still hard to believe that FB anti fraud measures can't figure it out. To me, something is off, whether with FB or these guys.
- nirvana 14y agoPlease explain to me why a bot would click on ads? (if anyone knows) Is it crawlers crawling Facebook? Are they alleging that facebook is doing it to boost revenues? Their hypothesis seems secure, given that you can't really use the facebook site at all without javascript enabled. More alarming is Facebook holding their name for ransom for the sum of $24,000 a year!
- jiggy2011 14y agoPossibly other advertisers trying to push competitors away from facebook so BigDickPillz Inc can have it all to themselves?
- pathdependent 14y agoYes. This used to happen a lot on ad networks, although I personally don't know how pervasive it is now. The game is as jiggy said. Force competing ad buyers to pay for what appears to be non-productive traffic by forcing ad clicks. Since the real views are dominated by false views, the conversion rate on whatever is being sold appears to be horrible. The competitor goes elsewhere, and the scammer maintains access to artificially cheap ad inventory, since there are fewer bidders.
- dclowd9901 14y agoHow does Google prevent this? Is it simply inherently not-problematic, due to their spread of advertising?
- veyron 14y agoOverall it's hard to say whether google wins or loses overall by this. In absence of a real competitor in the search ad space, people generally will swallow google's fee hikes ...
- pathdependent 14y agoIt's a cat and mouse game. Google gets good at it; scammers get more sophisticated; google catches up again; ad infinitum. Also, in addition to the scam mentioned above -- in Google's case, targeting AdWords -- they have to deal with scammers hitting their own AdSense properties. It's a well known problem. Considering AdWords is Google's primary source of revenue, they work hard at it. For a tiny bit more directly from Google, see: http://support.google.com/adwords/bin/answer.py?hl=en&answer=6114 http://support.google.com/adwords/bin/answer.py?hl=en&an...
- driverdan 14y agoI'd like to see the actual data from this. How much traffic are we talking about? Where were the bots coming from and how were they detected?
- reustle 14y agoCopying the text just incase FB decides they don't like it --- Hey everyone, we're going to be deleting our Facebook page in the next couple of weeks, but we wanted to explain why before we do. A couple months ago, when we were preparing to launch the new Limited Run, we started to experiment with Facebook ads. Unfortunately, while testing their ad system, we noticed some very strange things. Facebook was charging us for clicks, yet we could only verify about 20% of them actually showing up on our site. At first, we thought it was our analytics service. We tried signing up for a handful of other big name companies, and still, we couldn't verify more than 15-20% of clicks. So we did what any good developers would do. We built our own analytic software. Here's what we found: on about 80% of the clicks Facebook was charging us for, JavaScript wasn't on. And if the person clicking the ad doesn't have JavaScript, it's very difficult for an analytics service to verify the click. What's important here is that in all of our years of experience, only about 1-2% of people coming to us have JavaScript disabled, not 80% like these clicks coming from Facebook. So we did what any good developers would do. We built a page logger. Any time a page was loaded, we'd keep track of it. You know what we found? The 80% of clicks we were paying for were from bots. That's correct. Bots were loading pages and driving up our advertising costs. So we tried contacting Facebook about this. Unfortunately, they wouldn't reply. Do we know who the bots belong too? No. Are we accusing Facebook of using bots to drive up advertising revenue. No. Is it strange? Yes. But let's move on, because who the bots belong to isn't provable. While we were testing Facebook ads, we were also trying to get Facebook to let us change our name, because we're not Limited Pressing anymore. We contacted them on many occasions about this. Finally, we got a call from someone at Facebook. They said they would allow us to change our name. NICE! But only if we agreed to spend $2000 or more in advertising a month. That's correct. Facebook was holding our name hostage. So we did what any good hardcore kids would do. We cursed that piece of shit out! Damn we were so pissed. We still are. This is why we need to delete this page and move away from Facebook. They're scumbags and we just don't have the patience for scumbags. Thanks to everyone who has supported this page and liked our posts. We really appreciate it. If you'd like to follow us on Twitter, where we don't get shaken down, you can do so here: http://twitter.com/limitedrun http://twitter.com/limitedrun
- eytanlevit 14y agoHappend to us too!! we first thought kissmetrics was wrong, so we built a logger that logged server side requests and a client side code that executes on load of the landing page, and we found that 70% of the server side hits had javascript disabled(or that hit the page and left it before the js executed, which seems improbable for such a large number - 70%).
- clientbiller 14y agoJust curious, could it be a competitor and Facebook doesn't block them like google does for click fraud?
- logn 14y agoFB just gave him the best advertising ever through this publicity.
- jotto 14y agoOne POSSIBLE explanation for what Facebook would use anonymous bots for: verifying the advertisement goes where the advertiser said it would go. Facebook has problems with fraudulent or confusing advertisements. for example, iPad's being advertised for $2, but the user clicking the ad is sent to a penny auction site that bills you $100 when you sign up.... so that domain ends up getting banned, but those advertisers/spammers either create a new domain or they use a redirecting domain that redirects to a non fraudulent domain when they see an Facebook IP (in theory, the Facebook IP would mean it's an intern or Facebook bot checking the URL). Here's an example of the penny auction crap http://www.fastcompany.com/1771099/facebook-spam-ads-damage-dealzon-brand http://www.fastcompany.com/1771099/facebook-spam-ads-damage-... and an example of manipulating the landing page URL with a redirect http://www.larrylim.net/seo-online-marketing/facebook-ads-promote-scam/188/ http://www.larrylim.net/seo-online-marketing/facebook-ads-pr... so maybe it's Facebook's engineers trying to verify the ads are going to the place they're intended to go, but they are obviously incorrectly counting them as billable clicks
- deleted 14y ago[deleted]
- tectonic 14y agoTrue, but they shouldn't be charging for those verification checks.
- freshhawk 14y agoSo you think that a facebook ad checking bot is taking up 80% of the clicks? I know facebook doesn't have the best reputation for careful engineering but that's quite a stretch.
- 7952 14y agoWell why not? It is really more expensive to run such a bot at 80% rather than say 5%.
- pcarmichael 14y agoIf it was coming from Facebook, I would expect not to be charged for the clicks.
- gnaritas 14y agoI think the only fix for PPC is PPA.
- joshaidan 14y agoOne thing about Facebook ads, instead of buying clicks to webpages, you could buy likes to your Facebook page. This way you can at least look at the FID of the Like to get some confirmation that the Like you bought was from a real person.
- thejerz 14y agoWhy hasn't anyone asked what IP, user agent, etc. the bots were showing up as in the log?
- fchollet 14y agoVery unlikely to have been bots from FB, they're not yet quite that desperate. They would be 90% sure of getting busted, and it would be a huge deal breaker for a lot of their clients. A suicide move. The more plausible reality is that there are just a lot of bots crawling FB fan pages, poorly programmed bots that will just follow every single link they come across. That's very much in line with my personal experience of FB fan pages. But FB is certainly to blame for not detecting these as bots, and putting ads on the pages they serve them. Hopefully they'll take care of this issue soon.
- bigdubs 14y agoIn my mind having an in-house bot network and being totally ignorant that you're charging for bot traffic via ads amount to the same thing. This is very, very bad.
- stdbrouw 14y agoIt does not amount to the same thing at all. Keep some perspective.
- bigdubs 14y agoIt does amount to the same thing. If I am writing a mechanism to charge for ads based on traffic, one of the first things to QA/write test cases for is fraudulent traffic. The leap here is from facebook being remotely competent (which is likely), and willfully ignoring checks on certain types of traffic because it benefits them financially. My assertion is that this is the same class of bad behavior as running your own bots. Note the distinction in 'willful' ignorance.
- jokermatt999 14y agoHow? In house bot network implies active fraudulent charging, while being unaware of bot clicks is simply neglect or ignorance.
- deleted 14y ago[deleted]
- halis 14y agoFacebook couldn't be that pathetic...
- robomartin 14y agoI guess a more general question might be: I marketing on Facebook proving to be worthwhile? We are just finishing a new iOS app. It will be the first one in our catalog with a "Like us on Facebook" feature. I am skeptical about the value of this feature. Not sure it'll convert at all. Asked a bunch of people who use FB on a daily basis and most told me that they pay zero attention to ads or "likes". Not sure.
- alexlitov 14y agoI am surprised that there has been no proof released by the page owners. It feels a lot like a linkbait / FB viral campaign.
- iamdev 14y agoMy company also experienced not getting as much traffic to my site as facebook claimed. What I was told before I pulled my campaigns is that Facebook considers it a click when the visitor clicks your ad, but BEFORE the visitor is shown a "warning" screen that they're about to leave facebook. not sure if this has changed since. I haven't come back.
- kirillzubovsky 14y agoLovely to read a post that bashes Facebook, while containing no raw data leading to the vague analysis. For all I know, they got paid by Google+ to write this. Maybe they did, maybe they did't, but my assumption about the post's credibility is as good as their assumption about the results of their analysis. What a link bait!
- mattmaroon 14y agoThese bots, if they do exist, wouldn't be operated by Facebook. It's a market-based ad bidding system. If 80% of clicks are worthless, clicks will be worth 80% less, and advertisers will bid accordingly. Facebook won't make anything in the long run by doing this, and there's clearly risk of getting caught doing something illegal. If there is a bot, it's likely one of their competitors, though even that seems unlikely. One must be logged into FB to see ads, and I'm positive Facebook has some click fraud detection. They'd almost have to notice a number of accounts clicking the same ads over and over. I guess maybe if Facebook's CAPTCHA is weak enough and a bot was creating an account, setting up the proper interests to see the ad, clicking it, then repeating... Seems unlikely though. Also none of this explains why they're taking down their Facebook page. One does not need to buy ads to have a Facebook page. You can even have it automatically update from Twitter. They could leave it up there and get free publicity from it and simply cancel their ads. This whole thing seems like a sham for attention to me.
- mojowo11 14y ago> Also none of this explains why they're taking down their Facebook page. I think it pretty clearly explains why they're taking down their Facebook page. Just because you don't agree with them doesn't mean it's not explained. They're shutting down their Facebook page because (according to them) it's sitting around with outdated branding but they can't change the name unless they spend $2000/mo. Also because their user experience with Facebook has been crappy, and they don't want to have anything to do with them anymore. You know. Principle. Could be a sham for attention, but the article pretty clearly explains why they're shutting the page down.
- mattmaroon 14y agoCouldn't they just make another page with the correct name?
- mojowo11 14y agoThey could, but a) that's a pain in the ass, they'd have to build all the content out from scratch and b) they'd lose a ton of their Likes in the transition.
- captainchaos 14y agoWhat I don't understand is why someone would target bots to only Facebook click advertisements. Facebook offer the ability to create ads that also allow users to Like a page, RSVP to an Event, or Install a Facebook app -- all of these things would require 1) Javascript to be enabled and 2) a Facebook account. If bot Facebook accounts were created they would need to be at a fairly large scale to be effective (which would be difficult given that Facebook is fairly effective at finding and disabling obvious fakes -- anyone in this space has a hard time just creating a second testing account) and would be visible to advertiser since they can run analytics reports and view individuals who have acted on this types of ads. So, I'm more inclined to believe that if anything this a competitor of the advertiser gaming the system as some others have suggested. Still, like others I'm interested in seeing some of the data on this one.
- nhashem 14y agoMy startup is essentially an advertising aggregator (pooling traffic from a variety of publishers and routing it to advertisers) and dealing with things like bot detection is a HUGE chunk of what we work on, technology-wise. Let me try and give you an idea of how deep the rabbit hole can go. - Okay, you want to detect bots. Well, "good" bots usually have a user agent string like, "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html http://www.google.com/bot.html)." So, let's just block those. - Wait, what are "those?" There is no normalized way of a user agent saying, "if this flag is set, I'm a bot." You literally would have to substring match on user agent. - Okay, let's just substring match on the word "bot." Wait, then you miss user agents like, "FeedBurner/1.0 (http://www.FeedBurner.com http://www.FeedBurner.com)." Obviously some sort of FeedBurner bot, but it doesn't have "bot" or "crawler" or "spider" or any other term in there. - How about we just make a "blacklist" of these known bots, look up every user agent, and compare against the blacklist? So now every single request to your site has to do a substring match against every single term in this list. Depending on your site's implementation, this is probably not trivial to do without taking some sort of performance hit. - Also, you haven't even addressed the fact that user agents are specified by the clients, so its trivial to make a bot that identifies itself as "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:14.0) Gecko/20100101 Firefox/14.0.1." No blacklist is going to catch that guy. - Okay, let's use something else to flag bot vs. non-bot. Say, let's see if the client can execute Javascript. If so, let's log information about those that can't execute Javascript, and then built some sort of system that analyzes those clients and finds trends (for example, if they originate from a certain IP range). - This is smarter than just matching substrings, but this means you may not catch bots until after the fact. So if you have any sort of business where people pay you per click, and they expect those clicks not to be bots, then you need some way to say, "okay, I think I sent you 100 clicks, but let me check if they were all legit, so don't take this number as holy until 24 hours have passed." This is one of the reasons why products like Google AdWords don't have real-time reporting. - And then when you get successful enough, someone is going to target your site with a a very advanced bot that CAN seem like a legit user in most cases (ie. it can run Javascript, answer CAPTCHAs), and spam-click the shit out of your site, and you're going to have a customer that's on the hook to you for thousands of dollars even though you didn't send them a single legit user. This will cause them to TOTALLY FREAK THE FUCK OUT about this and if you aren't used to handling customers FREAKING THE FUCK OUT, you are going to have a business and technical mess on your hands. You will have a business mess because it will be very easy to conclude you did this maliciously, and you're now one Hacker News post away from having a customer run your name through the mud and for the next several months, 7 out of the top 10 results on any Google search for your company's name will be that post and related ones. And you'll have a technical mess because your system is probably based on, you know, people actually paying you what you think they should, and if you have no concept of "issuing a credit" or "reverting what happened," then get ready for some late nights. I'm seriously only scratching the surface here. That being said, I'm not saying, "this is a hard problem, cut Facebook some slack." If they're indeed letting in this volume of non-legit traffic, for a company with their resources, there is pretty much no excuse. Even if you don't have the talent to preemptively flag and invalidate bot traffic, you can still invest in the resources to have a good customer experience and someone that can pick up a phone and say, "yeah, please don't worry about those 50,000 clicks it looks like we sent you, it's going to take us awhile but we'll make sure you don't have to pay that and we'll do everything we can to prevent this from happening again." In my opinion this is Facebook's critical mistake. You can have infallible technology, or you can have a decent customer service experience. Not having either, unfortunately, leads to experiences exactly like what the OP had.
- joeblubaugh 14y agoRequiring an ad commitment before changing your name on Facebook doesn't make any sense. Anybody else hear of this kind of thing before?
- deleted 14y ago[deleted]
- ChuckMcM 14y agoSome background and a disclaimer. First the disclaimer, I've worked at Google (which lives of its search advertising) and now I'm with Blekko (which generates revenue from advertisements as well) so I've been on the 'inside' looking out at this problem. The background. A lot of the web you see today is automated, which is to say that 'the web' can exert influence in the 'real' world, and influencing the web can be amplified (or leveraged) as traders would say, with automation. Two examples, in the first example we have a thief who wants to steal money but doesn't want to go out and rob a bank. Instead he 'hires' Google (an unwilling partner here) and creates an AdSense account, makes a web site, fills it with AdSense add javascript, then writes a program that can fetch pages from his web site and click on an ad. He then feeds that to a botnet for hire (generally not an EC2 cloud) and has it go off and click on all his ads. Google congratulates him on what a great web site he launched, pays him anywhere $10,000 to $50,000 from ad revenue. And the party continues until the Advertisers complain or the traffic patterns pop out as suspicious. Obviously Google has a lot of folks who do nothing but look for this sort of abuse but when you're making numbers like they, even if you had 7 or 8 million dollars a month in click fraud it would be rounding error in their quarterly reports. The people who get pounded by this are the Advertisers which lost their $500 or $50 or whatever that month by being charged for clicks from machines that weren't ever going to buy their product. In the second example we have an ambitious entrepreneur who wants to get the word out on their new thing. They create over time a few hundred thousand 'fake' twitter accounts, they construct a community of fake accounts following each other. Then they write a simple program to have their 'influential' tweeters push out the word and their 'followers' pick it up and retweet it. If they have let the accounts lay there for a bit they pick up their own share of robot followers (from other people doing this) and our ambitious entrepreneur creates what looks like a real groundswell of interest in what ever thing they are trying to push. There are many rewards to automating web activities, for many different reasons. As a service provider its a full time job trying to insure I can identify the fake ones (I don't want to send ads to robots, they don't buy anything and they make me look bad to my advertising channels) That 80% of the 'clicks' this person got on Facebook fail a simple 'real user' test does not surprise me. I expect there to be a rise of landing pages which are themselves pages requiring you to click somewhere else and then clients only paying out when a prospect clicks all the way through to some part of the web site. I know that some big names already do this where they bring up a page asking you to identify your location (which helps them bring you to the part of the site for your area) but they also don't pay for the click unless you make it through that page.
- Halienja 14y agoWhat's a sure way of determining that the clicks are not coming from a proxy? I have to launch an online campaign. There are some many services that provide a high anonymous proxy and sometimes services like http://www.ip.cc/check-proxy-basic.php http://www.ip.cc/check-proxy-basic.php report a real ip as proxy. So how do I distinguish real clicks from fake users. During the signup, I can only collect Name and Email.
- javajosh 14y agoIsn't this why, oh, around 2005 CPA was the big thing instead of CPC? Personally, I think CPA is absolutely the right way to do internet advertising, and I wonder why FB doesn't do that.
- EternalFury 14y agoBecause they would not make a tenth of the money they do if they did that, obviously. Most sales or acquisitions originated online are based on rational decisions, not on the appeal of annoying ads. The day advertisers start to use a verifiable CPA system, 80% of online advertising cease to exist and 95% of today's start-ups see their cash vaporize.
- javajosh 14y agoWell then there's a huge market opportunity. When advertisers realize that their getting played by Facebook (and Google), paying for bad clicks, they'll look elsewhere - and CPA is pretty obvious solution (heck it's not even innovative). Is CPAFacebook.com taken I wonder? :)
- deleted 14y ago[deleted]
- deleted 14y ago[deleted]
- EternalFury 14y agoBecause they would not make a tenth of the money they do if they did that, obviously. Most sales or acquisitions originated online are based on rational decisions, not on the appeal of annoying ads. The day advertisers start to use a verifiable CPA system, 80% of online advertising cease to exist and 95% of today's start-ups see their cash vaporize.
- EternalFury 14y agoBecause they would not make a tenth of the money they do if they did that, obviously. Most sales or acquisitions originated online are based on rational decisions, not on the appeal of annoying ads. The day advertisers start to use a verifiable CPA system, 80% of online advertising cease to exist and 95% of today's start-ups see their cash vaporize.
- sun_tzuber 14y ago1) Buy facebook stock 2) Create massive ad clicking botfarm 3) ??? 4) Profit!
- sun_tzuber 14y agoMore realistically, it could also be used to drain your competition's ad budget, giving you a bit of an advantage.
- EricDeb 14y agoA related anecdote: My FB account was compromised recently (using my trivial 5 character password) and all the attackers did was occasionally sign on and like random pages. I kept getting odd company posts in my newsfeed and eventually traced the problem. These phishers/advertising bots are getting more and more creative...
- jyu 14y agoThis whole thing seems fishy to me. Facebook is one of my best sources of traffic. It's cheaper than AdWords, I can do keyword, demo, and geo targeting all built in. And if I have a hit campaign, it's pretty easily scalable. If you tie it into specific performance, like $ / email sign up, or $ / pageview, it blows away adwords. Getting in touch with someone from Facebook can be a pain, but it's drastically easier than AdWords or other ad networks. This whole thing seems like one big linkbait/PR play. It's a really big claim from a company that doesn't even have an about us page, has only 500 Facebook likes, and basically has 0 traffic.[1] I'd like to know if they have tried other paid traffic sources, or have concrete evidence. Inexperienced advertisers tend to spend $50-$100, expecting instant results. And when it inevitably doesn't work out, they blame anyone and everyone. I don't agree with the second point. Facebook isn't "holding your name hostage" and being "scumbags". You didn't sign up with the right name from the beginning, and now you're complaining. Instead of taking 5 minutes to sign up for a Facebook Page with name@limitedrun.com and get the page you want, you decided to sling mud with no real evidence. With only 500 facebook likes, the switching cost is low. [1] http://siteanalytics.compete.com/limitedrun.com/ http://siteanalytics.compete.com/limitedrun.com/ https://www.facebook.com/limitedpressing https://www.facebook.com/limitedpressing http://who.is/whois/limitedrun.com/ http://who.is/whois/limitedrun.com/
- ashcairo 14y agoI had the same thing happen to me, but with a YouTube video instead. Facebook would report and charge me for thousands of hits, while YouTube only showed up a few hundred.
- joshlegs 14y agoI wonder if this piece of news will make it to mainstream news outlets .... If it does, I would guess it will be a week or so. In any case, it really should get out because FB is a horrible platform of any sort. I don't even use the site; Facebook, no me gusta.
- kirubakaran 14y agoWhen a Facebook user clicks on an ad, Facebook already knows the likelihood of that user being a bot, based on information like their friends and other activity in that user account. Looks like Facebook chooses to not use this information as it will reduce their revenue.
- downandout 14y agoFacebook, like Google, uses a bidding system and expects the free market to compensate for invalid clicks/impressions. This should theoretically work - advertisers should be bidding lower since the clicks/impressions are worth less. However, unnatural market forces, like companies that are (at least for a while) willing to lose money on their their advertising continue to drive unrealistic pricing for their advertising. As long as Facebook can continue to convince new advertisers to try their system, and (perhaps more importantly) keep brand advertisers measuring ROI in terms of Likes instead of cash, prices will remain unnaturally high.
- shalmanese 14y agoI don't understand, who are the people profiting from click fraud on Facebook? Obviously Facebook is but we can pretty safely presume they're not coding bots on their own ad network. A competitor could maybe profit from it but this seems like a rather roundabout way to damage your competitors. What other rational business case is there to build click bots on Facebook? This is not like Google with AdSense where they pay out 3rd parties, the motivation there is clear.
- 23inside 14y agoI want to say: >80% of $FBs revenue is made from bots! OLOL but what I actually think is >They're just pissed their campaign didn't work out like they'd hoped BUT I also think that it's equally likely that $FB would, if possible, defraud the clueless. How deep are [client]'s pockets? How literate are they in working to strict ROI goals? I think this is probably a relatively new phenomenon. Facebook went public. Sales managers need to hit targets, they're thinking quarterly and they've got stock. People know people and the rest is history. If this has got legs then it's the perfect storm for facebook. :)
- Irishsteve 14y agoRan an ad a few months ago targeting twitter employee's specifically. What I found disappointed was a high rate of click throughs, (Maybe 300 Twitter employee's). But not one of them actually used the service (Which involved typing a query into a search box). This bot nonsense kinda makes me wonder if those 300 click throughs were really people.
- dspillett 14y agoThe comments about the company name make this look a bit more complicated. It sounds like they were increasingly unhappy about their relationship with facebook, and this new information is the final bail of hay.
- longhairedsi 14y agoWe need some real facts here, I've done a lot of FB advertising and have not seen results like this. This smells to me like an incorrectly configured campaign(s). Here are a few points that need addressing: What volumes are we talking about for the clicks? How many ads did you run per campaign and how many clicks did you receive per ad? Facebook do use bots to verify the landing page of an ad url, this will usually lead to one or two tracked conversions per ad. These will show up in the external website analytics software but won't be charged as clicks by FB. Were you running ads that drove directly to your website, or did you direct ads to your Facebook page? - Obviously ads that land on your Facebook page won't be tracked by your analytics software. How did you identify that links coming to your website had indeed originated from Facebook. Did you loose conversions through badly formed tracking urls and could it be these suspect page loads were actualy coming from a web crawler? Did you run CPM or CPC campaigns? - Maybe a misunderstanding of the charges involved?
- locrelite 14y agoJust a brief note: bot sophistication is off the hook. I worked at an ad network where one of the clients demanded we prove that the mouse had moved prior to "clicking" on one of their ads. No problem, we said, and most of the traffic passed the test. The traffic had referrers, legit user agents, javascript, and they were triggering the mousemove and click events. Out of curiosity, we sent a fraction of traffic to a test page, wherein the actual page was displayed in a full window iframe, then blocked access until the user clicked, and tracked their mouse movements. Easy enough; annoying for a user, but not a deal breaker for most. The user movement maps we ended up with were straight lines of randomly spaced dots with sudden acute corners. A human could not replicate the pattern with a ruler and a pen pad, and we certainly didn't expect 90% of our human users going for that client's sites to be sitting around with rulers and pen pads drawing lines of randomly spaced dots. We checked the testing code and ran a dozen tests, and we couldn't figure out how a human could replicate it on any browsing device. Our conclusion is that somebody bothered to program a bot that would replicate mouse movement and we accidentally broke it by blocking programmatic access to the page, so it couldn't find a link to click and went crazy.
- DanielBMarkham 14y agoCan somebody explain to me the business model behind bot clicks? I mean I understand if Facebook is doing it to drive up income (Although I don't believe it without some kind of proof), what I don't understand is why anybody else would be doing it.
- jyu 14y agoThis whole thing seems fishy to me. Facebook is one of my best sources of traffic. It's cheaper than AdWords, I can do keyword, demo, and geo targeting all built in. And if I have a hit campaign, it's pretty easily scalable. If you tie it into specific performance, like $ / email sign up, or $ / pageview, it blows away adwords. Getting in touch with someone from Facebook can be a pain, but it's drastically easier than AdWords or other ad networks. This whole thing seems like one big linkbait/PR play. It's a really big claim from a company that doesn't even have an about us page, has only 500 Facebook likes, and basically has 0 traffic.[1] I'd like to know if they have tried other paid traffic sources, or have concrete evidence. Inexperienced advertisers tend to spend $50-$100, expecting instant results. And when it inevitably doesn't work out, they blame anyone and everyone. The second point seems way exaggerated. Facebook isn't "holding your name hostage" and being "scumbags". You didn't sign up with the right name from the beginning, and now you're complaining. You could have told the ad rep that you'll do $2,000 budget at some point, just change the url now. You could have also taken the 5 minutes to sign up for a Facebook Page with name@limitedrun.com and get the page you want. With only 500 facebook likes, the switching cost is low. [1] http://siteanalytics.compete.com/limitedrun.com/ http://siteanalytics.compete.com/limitedrun.com/ https://www.facebook.com/limitedpressing https://www.facebook.com/limitedpressing http://who.is/whois/limitedrun.com/ http://who.is/whois/limitedrun.com/
- herdrick 14y agoWhy does this have the confident feel of a chain email, or spam? I'm suspicious.
- EternalFury 14y agoThe world just learned that no human being ever clicks on these ads? WOW! Amazing.
- belgianguy 14y agoRelevant experiment done by the BBC: http://www.bbc.com/news/technology-18819338 http://www.bbc.com/news/technology-18819338 (paraphrased) "Virtual Bagels": A company that does nothing gathers 4000 likes in 4 days. When set to Worldwide, it soared from hits in Egypt, Indonesia and the Philippines. When limited to the UK the needle barely moved.
- mmaunder 14y agoThe data here is clear. 80% of clicks are from non JS clients. There's no getting around this. I run an ad network, a real-time analytics product and a WordPress security product that provides real-time traffic and we use JS vs non JS to distinguish between human and non-human for our customers and it is 95+% reliable. As an ad network provider it's your responsibility to filter spam clients based on heuristics like click frequency from a geo location, JS support in clients, behavior of ISP IP blocks, etc. It may be that this customer was specifically and exclusively targeted, but even so FB should have mechanisms in place to deal with and block this. This is not a good sign, but then as I've mentioned before I don't think ads is a viable model for FB, so perhaps their energy is being directed elsewhere.
- joeblau 14y agoThis is a pretty interesting finding. Has your team considered acutally spinning off a consulting branch or creating a plugin that other companies can use to determin if they are paying for bot clicks? That would probably be pretty helpful for others and a great way to draw attention to the issue. I'm sure if they see a growing number of companies stop advertising on the site, they may start to pay attention.
- tlb 14y agoTwo other hypotheses they don't seem to have ruled out: - Their site is so awful that 80% of people click back before the page finishes loading, thus appearing to not have javascript - Their ad is so awful that almost no people click it and a few bots make up 80% because the total is so low.
- foxylad 14y agoPardon my naivety, but why would a third party want to set bots onto Facebook ads? I guess one could hope to exhaust a competitor's marketing budget, but surely this isn't an established tactic. Even more Machiavellian would be Google doing it to discredit Facebook's entry into the advertising business. I doubt this because they've got too much to lose - if they were discovered, it would seriously hurt their "don't be evil" reputation, which is worth billions to them. And just imagine the anti-trust suit... Although Facebook stands to gain the most from this, my argument about reputation damage applies there too. So who is paying for the bots?
- damian2000 14y agoA response from FB: http://www.latimes.com/business/technology/la-fi-tn-facebook-limited-run-response-20120730,0,5059899.story http://www.latimes.com/business/technology/la-fi-tn-facebook... "There must have been miscommunication with Limited Run" "Facebook says it is investigating claims made by Musician site Limited Run early Monday regarding ad clicks by bots." "We're currently investigating their claims," a spokeswoman for the company said in an email. "For their issue with the Page name change, there seems to be some sort of miscommunication. We do not charge Pages to have their names changed. Our team is reaching out about this now."
- Freestyler_3 14y agoWonder how they will spin this. First they try the silence mode, see if it dies out if they give no attention. Then deny it was them and they were unaware of the problem BUT they are working on something that will totally eradicate said problem and of course more but we can't give details on us.
- uladzislau 14y agoQuite interesting top comment on Reddit thread http://www.reddit.com/r/technology/comments/xel55/startup_claims_80_of_its_facebook_ad_clicks_are/ http://www.reddit.com/r/technology/comments/xel55/startup_cl... "I can confirm this. I used Facebook to advertise my page and went from ~2000 fans to over 6000 within several months. Awesome, right? Wrong. I thought it was weird that the new fans would never, EVER interact with the pages. So I started stalking their profiles. Guess what? Bots/hijacked accounts/fake accounts. How do I know? Many of them have NO friends. Then I noticed something really scary...repeats. Actual pictures showing up more than once for new likes. Very, very few of the accounts were from the USA. I started casually messaging the accounts that looked suspicious. Not a single one with no friends responded. Out the ones that looked legitimate (although with a list of likes that is in the thousands), only a handful replied, and 100% of those people confirmed they found my page through affiliated sites, and not through Facebook itself. I ended the ad program recently and the bots stopped. tl;dr: Do not, under any circumstance, advertise with Facebook. They will feed you fake likes. If you want fake likes, use a site like fiverr to generate them, it's way cheaper and yields identical results."
- latetext 14y agoI have lost faith in hackernews, after this stupid post.
- latetext 14y agoI have lost faith in hackernews, after this stupid post.
- saurik 14y agoOut of curiosity, I just went back to a campaign I ran last year with Facebook to see if I was affected. I spent $2k on CPC advertisements with a filter targeting people related to phones, Cydia, Apple, etc.; the result was that I caught enough people that some smaller blogs reported on my ads. http://www.givememind.com/saurik-advertises-cydia-tweak-on-facebook-youmail-visual-voicemail/ http://www.givememind.com/saurik-advertises-cydia-tweak-on-f... So, this campaign lasted one day, just over a year ago, on July 22nd. During this time, Facebook claims I got 5229 clicks. According to Google Analytics (which will only log users whom have JavaScript working and enabled), I got 5057 hits to that landing page. Finally, working from logs, I have managed to find 5643 total requests for the URL. If I filter for those that explicitly sent a referer from facebook.com/ajax, I see 4644; of course, many people have browsers that do not send referers due to various reasons. Therefore, I feel safe concluding that, for my website, a year ago, I was not having "80% of ad clicks from bots". I present this evidence in order to help people attempting to understand this issue to provide the possible clue that this is either "user-specific" or "changed in the last year".
- Wyfurl 14y agoIn January my startup ran a trial Facebook ad campaign using a free $100 advertising credit from Facebook. Extremely pleased with the results, we started paying to advertise and immediately noticed a substantial drop off in the conversion rate (down over 70%) even though we were using the same targeting, ads, and made zero changes to our website. As a Facebook advertiser, user, and stockholder, I'm not impressed.
- c3d 14y agoMaybe it's time for the web to switch to a model where revenue is not driven by clicks, but by actual transactions. It's harder, of course, but it would sanitize things a bit. Hopefully, bots won't learn how to pay. And if they do, well, it doesn't hurt.
- markrabkin 14y agoHey, I'm an engineering manager on the Ads team at Facebook and have been working on our Ads Marketplace Quality team for a couple of years now. We take reporting accuracy seriously and have a variety of systems in place that may filter out some clicks and impressions before they ever appear in charges or reports. For example, we may invalidate repetitive, incomplete, or otherwise abusive clicks, and we cap the number of times any user can see or click on particular ads in a day. We also monitor traffic and click patterns across the site and try to filter clicks that appear to be generated by bots or other automated systems. We work closely with our general spam and fraud fighting engineering team called "Site Integrity", which does great work trying to detect fake users, bots, and users infected with malware. A lot of sophisticated advertisers use Facebook, and many of them perform all kinds of validation of the effectiveness of their advertising on our site. Many advertisers also use various analytics systems to monitor the clicks they receive through our ads platform. We are constantly working with advertisers and partners to help ensure we deliver ads that are valuable to our users and advertisers. We care about this area of work a lot.
- Tichy 14y agoI don't understand why the bots click on the ads? Of course an old school crawler would just "click" on any link on the page, but I would assume most ads are included by JavaScript and would therefore not be crawled by standard crawlers?
- andrewfelix 14y agoOff topic; was any one else astounded by the misinformed and misguided comments on the FB post? Quite a contrast from HN.
- normanf 14y agoWell, I have also tried to advertise on Facebook and saw the numbers of clicks shown in Facebook reports are much higher than the number of visits shown in the Google Analytics. It was rather strange. Besides, the support team has just ignored all my letters where I tried to define what goes wrong. As a result, I just stopped advertising campaign and wrote this article http://blog.britainloans.co.uk/2012/06/our-ambiguous-experience-in-advertising-on-facebook/ http://blog.britainloans.co.uk/2012/06/our-ambiguous-experie...
- jarsj 14y agoInteresting. I just tried browsing facebook with Javascript off and pretty much nothing works. I can't comment, can't share, can't like. But guess what, ads show up and they can be clicked.
- nawitus 14y agoIs it actually necessary to weed out bot-clicks? If all sites have equal amounts of bot-clicks, then you can just charge 80% less per click (compared to the situation where all clicks would be human). Perhaps in practice the bot percentage changes widely per-site, so it's still important to have statistics on bot-clicks.
- wee_man 14y agoI work in the digital advertising industry, more specifically on ad exchanges and various behavioral targeting platforms. Facebook is scrambling to monetize their traffic like never before, as a reaction to fallout from their horrifically botched IPO. They recently announced the launch of a beta ad exchange, FBX, that for the first time will allow outside advertisers to access Facebook inventory for behavioral targeting. So if you are researching a flatscreen TV on Best Buy, you could start seeing TV ads on Facebook. This is common practice across all e-commerce websites, but until now FB has been a closed inventory platform. This means that the clicks and actions from the Facebook audience are being scrutinized more than ever, and those have to be quality clicks (not bots). General Motors recently announced their complete withdrawal from FB because of poor advertising performance (again, bots). Facebook is fucking up royally on the business side of things, so for the sake of sustainability I hope they are still laser-focused on product.
- agscala 14y agoThe solution is obviously to make the user fill in a captcha whenever they click on an ad to confirm they are indeed human
- podperson 14y agoSeems like a simple problem for Facebook to deal with: User clicks more than one ad per [pick some time threshold -- hour] on average ==> probably bot. User clicks more than one ad per [pick some time threshold -- minute] ==> probably bot. User clicked more than [pick threshold -- 20] ads in a month ==> probably bot. FB doesn't even need to get these numbers right, it just needs to set the values so that false positives cost it an insignificant amount of money.