3 ms·
Semi-OT: On the subject of GitHub's robots.txt[0], would anyone have a guess at why this particular repo[1] is singled out? [0] https://github.com/robots.txt
by ConstantineXVI 14y ago
Semi-OT:
On the subject of GitHub's robots.txt[0], would anyone have a guess at why this particular repo[1] is singled out?
[0] https://github.com/robots.txt https://github.com/robots.txt
[1] https://github.com/ekansa/Open-Context-Data https://github.com/ekansa/Open-Context-Data
- underwater 14y agoIt could be a honeypot. Any robot that crawls that URL gets auto-banned.