4 ms·
How is this possible, without Apple bot showing up in my access logs? Would they disguise it as a WebKit client? But then, they should also respect the robots.t
by Demiurge 13y ago
How is this possible, without Apple bot showing up in my access logs? Would they disguise it as a WebKit client? But then, they should also respect the robots.txt, and I've never seen anything but known crawlers in there.