2 ms·
Most crawlers/bots, particularly the ones you want to be able to identify, spoof their user agent, making this mostly moot.
by Jamwinner 7y ago
Most crawlers/bots, particularly the ones you want to be able to identify, spoof their user agent, making this mostly moot.