4 ms·
Yes it was. But I should have been clearer for the type of literal argument starters that would tend to hang around here ;) I wonder if google always honour ro
by michaelneale 19y ago
Yes it was. But I should have been clearer for the type of literal argument starters that would tend to hang around here ;)
I wonder if google always honour robots.txt
- Hexstream 19y agoI hope so because otherwise they could get stuck in one of those: http://en.wikipedia.org/wiki/Spider_trap http://en.wikipedia.org/wiki/Spider_trap