3 ms·
The problem is that the publishers want to have their cake and eat it too. They’ll happily let Google index the pay walled articles but won’t let you read them
by Nextgrid 7y ago
The problem is that the publishers want to have their cake and eat it too.
They’ll happily let Google index the pay walled articles but won’t let you read them for free, thus polluting search results.
The expectation is that anything you see on Google (aka what the Googlebot was able to access without authentication) should be accessible for free without login or signup. These websites break that expectation, making search result pages unusable.
Publishers want this behaviour, so they implement their paywalls in such a way that they trigger on browsers but not for search engine crawlers (usually because they are JS-based and simply obscure the content below it). This extension exploits that fact. Publishers are free to implement a true paywall where the server wouldn’t serve any content without auth (thus defeating this extension) but this also means restricting search engines, something they definitely don’t want.
Finally, the “ethical” option of paying for the content is also out of the question for many due to privacy concerns. Many publishers have Facebook, Google Analytics and similar spyware on all their pages regardless of whether you’re a subscriber, so they will still track you except now you need to pay and provide validated billing details.
- iso1210 7y agoI'm sure in the past search engines checked for this type of behaviour and punished it. If you give a special 'optimised' page to a bot, but give something completely different to regular people, then that's a failing of the search engine.
- kimi 7y agoLike Quora?
- KarlKemp 7y agoIt’s quite a feat of logical contortion to somehow claim a privacy motive to legitimize your unwillingness to pay. Unless, that is, you never buy anything online. Because Netflix and airlines and food delivery and Amazon all run tracking on their sites, and a single vendor with Google Analytics would presumably be enough to let them tie your browser to your identity. In that case you’d still be excessively paranoid, but at least consistent about it.
- tareqak 7y agoI disagree. There is a difference between first-party tracking (e.g. Netflix) and third-party tracking. I’m well aware of first-party tracking and how it can be helpful. However, both third-party tracking and the sale of first-party tracking information is unconscionable in my opinion: therefore, rewarding that behaviour with currency is equally unconscionable to me.