3 ms·
Can you not exclude it with robots.txt? It would be a shame for humans to lose the resource you intended to share.
by djmips 3y ago
Can you not exclude it with robots.txt? It would be a shame for humans to lose the resource you intended to share.
- JohnFen 3y agorobots.txt is not nearly sufficient for this purpose.