7 ms·
I had a discussion with tptacek about this one day. See, I don't think Google (the search engine whose opinion's most influence my thoughts -- no offense DDG)
by patio11 16y ago
I had a discussion with tptacek about this one day. See, I don't think Google (the search engine whose opinion's most influence my thoughts -- no offense DDG) sees content farms as a bad thing.
If someone is searching for "how to make a blueberry pie", and they get an article entitled "how to make a blueberry pie", they're happy. Are they actually going to make a blueberry pie? Probably not. Therefore, it doesn't really matter whether they get a good blueberry pie recipe or a bad blueberry pie recipe. As long as they quickly get to a well-designed page that they won't read anyhow because no one reads on the Internet which has a few bullet points they'll skim fast and a blueberry pie picture on it, they're happy. Their blueberry pie voyeurism need is fulfilled.
Content mills make that happen, for huge segments of the population. Let me strip that of euphemism: content mills make this happen for women, the elderly, and the technically disinclined. Absent the content mill, there is insufficient "organically produced" content on the things they care about on the Internet because their participation on the Internet is dramatically less than y'alls participation is and y'all -- speaking in generalities -- do not blog about good blueberry pie recipes.
You can think of content mills as an organism in symbiosis with Google: how to you juice relevance algorithms to identify the sliver of a sliver of a fraction of the Internet which talks about blueberry pies and other things your mom cares about, identify the best tangentially related article, and present it to her every time? Well, you could have your crack teams of geniuses work on it for a few years, even though your favorite tricks like PageRank are likely to function less well because there's less linking data to go around. Or, in the alternative, you could encourage content farming.
It surely has not escape Google's notice that their bottom line revenue increases by about 80% of the top-line revenue of the entire content farming industry, incidentally. Contextual ads are the perfect monetization vehicle for laser-targeted content produced at quality which will be solely viewed in search mode, and Google owns that entire field.
- moultano 16y agoI work in search quality at Google, and while certainly not everyone agrees that it's a problem, a lot of people do. I could write a lot about this, but the central issue is that it is very very hard to make changes that sacrifice on-topic-ness for good-ness that don't make the results in general worse. We're working on it though, and I suspect we'll never stop. I think a lot of the promise lies in as you said, identifying the tangentially related article, or as I like to frame it, bringing more queries into the head. We've launched a lot of changes that do exactly this. (But you are right, it is difficult, and fundamentally so. Language is hard.)
- chubs 16y agoCan you please please please somehow tell someone important to get rid of those phony review sites, which when you get there have zero reviews of the item in question?
- moultano 16y agoGive me some examples if you can. I'll send them around.
- veemjeem 16y agoHere's a phony one: http://www.mahalo.com/3g-iphone-reviews http://www.mahalo.com/3g-iphone-reviews That site has a few thousand crappy reviews scraped from all over the place. It comes up on google all the time and it's something that I automatically ignore.
- arohner 16y agoIt is a problem. Things like MFA spam and Google's recent trend of being less useful as a Search Engine for Programmers (ignoring quotes, ignoring punctuation like ? and !) are enough to make me switch, if I find something better. This article has convinced me to try out DDG for a little while.
- moultano 16y ago>ignoring punctuation like ? and ! Google has done this since launch, I don't think it's a recent trend. I agree though that searching for programming information isn't great. (It's even harder with math.) I doubt you'll find MFA spam to be better on DDG than on Google, but please, if you see a query where they are beating us. Send it over. :) I can guarantee you that I'll get a lot of eyes looking at it.
- wanderr 16y agoKudos, I was about to submit a longstanding complaint but it looks like it has been fixed. For a long time Google was autocorrecting my searches for gearman as "gearman" -- not just in a "Did you mean?" but actually giving me search results about germans instead of gearman. I'm not sure when it happened, but results are sane and accurate again, even for things like "gearman workers" and "gearman jobs".
- gojomo 16y agoThere are other indirect mechanisms whereby content-farm-junk -- aka 'spablum' -- benefits Google. What if spablum doesn't prevent a person from eventually finishing their task, but lengthens their browsing/searching session, requiring a few reformulations? Up to a certain threshold -- when the person gives up entirely or tries a competitor -- such delaying tactics may give Google more AdWords and AdSense impressions and clickthroughs. Next, as the quality of natural search results drops, the value of the paid-placement slots goes up -- for both advertisers and users. This is one giant hole in the argument that it's effortless to switch to another search engine, if it offers better natural search results. Lots of the value from Google searches now comes from the relevant ads -- only if Google were to let competitors run ads from the same pool would this switching cost be eliminated. Finally, the quality arms-race is something deep-pocketed, heavily-PhD'd Google can fight indefinitely... but adds an immense barrier to new shoestring operations. Google, given its position, would be perfectly happy if search quality just hovers where it is (or even declines slightly) -- as long as the cost for potential competitors to achieve that same search quality, at scale, grows moreso than for Google.
- moultano 16y agoI can guarantee you that no one in search quality, outside perhaps of the people who work in ui, care one bit about the revenue effects of what we do. Someone in the company certainly does, but not anyone in the chain of command of people who have control over ranking launches. If the results suck, by all means, rail on Google and tell us we're doing a crappy job, but there's no need to suspect an ulterior motive. Every so often, some well meaning salesperson will email one of the search quality mailing lists because they think there's a problem with how we are indexing/ranking one of our Adsense or Adwords customer's sites. Every single time, I've seen the person sternly told by a VP to never email those lists again.
- Ardit20 16y agoSo what do you guys actually do? I mean, it would be hard for me to say that the search results from google have increased in quality at all in the past five years at least.
- jacquesm 16y agoThat sucks for those that actually are going to make blueberry pie.
- todayiamme 16y agoAlthough, I agree with your point. This bit offended me a bit; >>>content mills make this happen for women, the elderly, and the technically disinclined.<<< ---- On the other hand, have you ever thought about making an interface that does this at a glance instead of an algorithm? Why should a person go to pages at all? Even better why can't people see how pages related to their queries are interconnected? For e.g. you enter a few search terms. Google calls a few results up. Now, maybe you can do meta-parsing? It is simply too computationally expensive to parse the entire internet using NLP, but if you can do it at two levels then you should be able to reduce costs and increase efficiency. After that you show the results in a tree like structure with screen grabs of the page in question and an automatically generated summary. Now, the user can select any one of these pages and you open them up again according her/his query. You keep on generating this tree until you hit a semantic dead end i.e. the pages that are about to be opened have no relation with the original query. Something like this should be impervious to content farms for a simple reason. The user has the ability to skim over the content presented and can visit what s/he likes. So, the content farms can't bait her/him. Moreover, since several sources are displayed visually side by side and their interconnections and sub references are shown the user should be better able to judge what to visit and what not to visit. Moreover, you can make it smart and tailor it for users so that links they seldom visit get omitted from subsequent trees. I've wanted to make something like this for a long time, but I don't have the knowledge to do so. I would love to learn though. I think that the next frontier of search isn't optimizing the algorithms, but to change the way results are presented through more intuitive UIs. [I am assuming that content farms simply set up pages without verifying the validity of the content]
- barrkel 16y agoThe content farms hurt most when I'm doing a focused query, e.g. trying to make a purchasing decision or discover a specific fact about a very particular topic. Many times, when searching for specific products to buy, you get page after page of review aggregation sites filled with affiliate sales links, often with the same reviews, over and over again. At other times, you get poorly written generic content farms that almost trap the reader with the hope of getting what he wants, until it eventually dawns on him that the site is basically a fluffed out set of wikipedia pages. Here's one I reported to Google as search spam: http://www.motorcyclepartstrade.com/ http://www.motorcyclepartstrade.com/ I was looking for motorbike gear some months ago, and ended up on this site. The odd thing about it is it looks a bit like a shop of some kind - "parts trade" and all that - and it even says "search through our large inventory of motorcycle parts", but it's not actually a shop, just a huge web of interlinked articles. The only ad at the current time is a static link to digitalroom.com.
- Vivtek 16y agoWait. Are you seriously saying that women don't search for actual information, but just to satisfy their flighty little minds? Are you posting from the 50's or something?
- carussell 16y agoIf someone is searching for "how to make a blueberry pie", and they get an article entitled "how to make a blueberry pie", they're happy. Are they actually going to make a blueberry pie? Probably not. I skimmed the immediate replies, and people seem to be taking the "Yes, and" approach, so I'll ask. What the fuck are you talking about, man?