2 ms·
You're assuming ill-behaving crawlers wouldn't show you a completely mundane user-agent. I know they often don't... and I wonder why they don't, but there's no
by krapp 10y ago
You're assuming ill-behaving crawlers wouldn't show you a completely mundane user-agent.
I know they often don't... and I wonder why they don't, but there's no reason they should.
- deleted 10y ago[deleted]