3 ms·
> If you're Google, you get the full HTML, if you're not, you don't. reply This company isn't Google either, though. Or are you suggesting that they're using
by PragmaticPulp 5y ago
> If you're Google, you get the full HTML, if you're not, you don't.
reply
This company isn't Google either, though.
Or are you suggesting that they're using Google Compute Engine and therefore get the unpaywalled version?
- gruez 5y agoThat might work with crappy implementations (eg. they check ASN = Google), but google publishes a whitelist of their crawler bot IP ranges, so spoofing that is all but impossible.