3 ms·
This is highly annoying and rude. Is there a complete list of all known bots and crawlers?
by noman-land 2y ago
This is highly annoying and rude. Is there a complete list of all known bots and crawlers?
- jsheard 2y agohttps://darkvisitors.com/agents https://darkvisitors.com/agents https://github.com/ai-robots-txt/ai.robots.txt https://github.com/ai-robots-txt/ai.robots.txt