4 ms·
That's the rule for crawlers that aren't Slurp, Googlebot, Teoma, or msnbot.
by ivank 16y ago
That's the rule for crawlers that aren't Slurp, Googlebot, Teoma, or msnbot.
- Tichy 16y agoI noticed the extra rules, but I am neither Slurp, Googlebot, Teoma nor msnbot :-(