3 ms·
> no human looks at robots.txt of course people look at this. it's not an everyday thing for the prototypical web user, but some of us look at those a lot.
by naikrovek 2y ago
> no human looks at robots.txt
of course people look at this. it's not an everyday thing for the prototypical web user, but some of us look at those a lot.
- pkaeding 2y agoYes, but those of us also often have trouble solving captchas.