4 ms·
They make it sound a lot sexier than it is. When Blekko was serving up search pages we had over 200,000 machines at any given time identified as botnet/fraud so
by ChuckMcM 11y ago
They make it sound a lot sexier than it is. When Blekko was serving up search pages we had over 200,000 machines at any given time identified as botnet/fraud sources. Perhaps it was because we were providing search results to "tier n" search portals that we got to see more of the folks trying to scam the advertisers but we got really really good at not serving up ads or counting clicks on robots. Something ad publishers really appreciated.
If you're serving up SERPs there are lots of interesting things you can do, like make white space clickable but not go anywhere, (humans click on the ads, bots click on the giant click box.) Serve up an invisible "first ad" on the top left, center, and right of the page. Tons of these robots just click the top ad they think they find. When IP's in europe, brazil, mexico and the Ukraine all search for the exact same english string and always click on the third ad down, well you can just put all of that addresses in the equivalent of an Ad "virtual kingdom" (they think they click but they don't go anywhere useful).
Lots of funny stories, my favorite was sending Google traffic to Google ads and having Google tell us it was fraudulent traffic. That was pretty funny.
- cromwellian 11y agoMy guess is, given the scale, and amount of money on the line, the attacks against Google are far more sophisticated than just bots blindly clicking on ads.
- ChuckMcM 11y agoI would hope so! But even a place like Ask.com is clearly a couple million dollars a day in ad revenue.
- sanswork 11y agoI wrote an ad system that was in part used to backfill Ask in a few countries and even with just backfill I was amazed at how much traffic they were still doing. Though I'm pretty sure most of it was toolbar traffic.
- deleted 11y ago[deleted]
- spyder 11y agoYes, there is so much money in it that it's very likely there are bots with an AI trained on real human behavior samples, making it hard to distinguish from real clicks.
- ChuckMcM 11y agoActually easier than this, a bit of spyware that looks at your searching/clicking habits over a very long period and then sends that to a big mixer which then replays the same search/click with the same timing and mouse motion. I remember seeing a World of Warcraft automation script being demonstrated and thinking that it was probably used to abuse ad networks.
- SagelyGuru 11y agoThere was a time when Google was a likeable company creating good search engines. Now it is all about battles over the ads. In what sense is that still beneficial to an ordinary web surfer? Is this an inevitable progression or is it a matter of wrong priorities?
- danmaz74 11y agoIf you want good search engines without having to pay to use them, then those search engines need to run ads...
- jacquesm 11y agoIs there a good ad-free search engine that I can pay for?
- jfuhrman 11y agoThe issue with search engines is that they tend to get very good by using clickthrough data, so the more you use something the better it gets. Indexing and ranking algorithms can only do so much. The interesting question is that does Google own the click through data or does the user? Does Google exclusively own the fact that you clicked on the 4th link in Google leading to php.net when you searched for 'php'? Or can the user or government get this data to alternate search engines for better competition just like they forced Microsoft to open up Office file formats and SMB protocol docs to their rivals? If you remember the big deal about the optional Bing bar in IE uploading the search term and clicked URL in Google search results to Bing it looks like many people on here think Google exclusively owns the clickstream data, and it's not the users' to do what it wants. This is the reason that a paid search engine won't do very well, just like a paid social network wouldn't, because both rely on a lot of people using it to seed it and a paywall will hurt.
- ChuckMcM 11y agoIt is the interesting question of our times isn't it? I did the calculation for Blekko at one time and a couple of million paid subscribers could have floated the base search engine. It is hard to find people to subscribe to things on the internet though unless they are MMO games :-)
- frik 11y agoSad of the demise of Blekko search engine. It's now part of IBM to build their inhouse "freebase" style data source for Watson AI, as Google closed freebase.com I wonder what DuckDuckGo will do, as their primary search source the Yahoo BOSS API got more expensive in June 1, 2015: https://developer.yahoo.com/boss/search/#pricing https://developer.yahoo.com/boss/search/#pricing ($1.80 per 1000 Queries; the free tier is no more)
- Scoundreller 11y ago$1.80/CPM should be absorbable with ad revenue, but I fear the average DuckDuckGoer runs ad blockers, blocks javascript, runs Ghostery and doesn't click on ads very often... Looks like the old pricing was $0.80/CPM. Any idea if they have a direct contract with DDG?
- cpeterso 11y ago> When IP's in europe, brazil, mexico and the Ukraine all search for the exact same english string and always click on the third ad down, well you can just put all of that addresses in the equivalent of an Ad "virtual kingdom" (they think they click but they don't go anywhere useful). How much of a server drain is the "virtual kingdom"? Could you point those trap ads to some host or IP address that takes a long time for the client to reach, offloading the wasted time from your server to their client?