3 ms·
The publishers view robots.txt as a catch-22: be indexed and lose money or refuse to be indexed and lose money. So they're trying a third option: demand to be i
by wmf 12y ago
The publishers view robots.txt as a catch-22: be indexed and lose money or refuse to be indexed and lose money. So they're trying a third option: demand to be indexed and demand to be paid.
- x0x0 12y agohow exactly does this require indexing?