3 ms·
It's so cute how people think anyone obeys robots.txt :)
by pdntspa 2y ago
It's so cute how people think anyone obeys robots.txt :)
- memhole 2y agoI personally don’t even bother with it for these reasons.
- CommanderData 2y agoRobots.txt? Just send a fake user agent.
- skybrian 2y agoAnd why should anyone believe you when you didn’t give any evidence of anything?
- qup 2y agoHe didn't even make a claim