3 ms·
Somebody remind me again why either robots.txt or serving a 402/Payment required to crawler UAs doesn't work?
by groby_b 14y ago
Somebody remind me again why either robots.txt or serving a 402/Payment required to crawler UAs doesn't work?
- fforw 14y agoBecause the publishers want their cake and eat it. They want to be found by Google, but Google should pay them for it. Because they're awesome and the protectors of culture and everything good and right.