3 ms·
> no human looks at robots.txt :) I... I do... sometimes. Mostly curiosity when the thought randomly pops on my head. I mean, I know I might be flagged by the
by quectophoton 2y ago
> no human looks at robots.txt :)
I... I do... sometimes. Mostly curiosity when the thought randomly pops on my head. I mean, I know I might be flagged by the website as someone weird/unusual/suspicious, but sometimes I do it anyway.
Btw, do you know if there's any easter egg on Hacker News' own robots.txt? Because there might be.