6 ms·

How is this a Google Tax? Websites indexed by Google give permission in their robots.txt file (or lack thereof)

• wmf 12y ago
  The publishers view robots.txt as a catch-22: be indexed and lose money or refuse to be indexed and lose money. So they're trying a third option: demand to be indexed and demand to be paid.
  • x0x0 12y ago
    how exactly does this require indexing?