5 ms·
Worked for me. what? Bypassing the paywwall is this simple? Does this work for other news sites with paywall?
by alant 9y ago
Worked for me. what? Bypassing the paywwall is this simple? Does this work for other news sites with paywall?
- Whitestrake 9y agoMost news sites, yes. They want Google's crawler to crawl their full text, and Google responds poorly to sites that treat their crawler differently than real search users, so if your Referer (sic) header is Google, news sites will often give you the whole article.