3 ms·
There doesn't seem to be anything about it in HN's robot.txt. Of course, it may have been implemented in other ways.
by haasted 18y ago
There doesn't seem to be anything about it in HN's robot.txt.
Of course, it may have been implemented in other ways.
- andrewparker 18y agoWhat are those "x" URLs blocked in the robots.txt for HN?