3 ms·
Does Ahrefs not respect robots.txt? Their website says they do, https://ahrefs.com/robot/index.php https://ahrefs.com/robot/index.php
by devicenull 13y ago
Does Ahrefs not respect robots.txt? Their website says they do, https://ahrefs.com/robot/index.php https://ahrefs.com/robot/index.php
- bediger4000 13y agoI don't know if I tried that. Originally, I wanted to let them know they were forbidden, but now I just want to jerk them around.