3 ms·
The User-Agent was not random; that's how I was able to block them this time.
by bovermyer 2y ago
The User-Agent was not random; that's how I was able to block them this time.
- szszrk 2y agoBut they were far from honest, if, as you say, crawlers impersonate real users and their browsers.