2 ms·
For me it's semrush, not being able to understand robots.txt wildcards, and 20x more traffic than normal bots. What are they doing on a movie site anyway? No pr
by rurban 2y ago
For me it's semrush, not being able to understand robots.txt wildcards, and 20x more traffic than normal bots. What are they doing on a movie site anyway? No problem with claudebot