3 ms·
The web is a public space. There are no doors. Robots.txt is a way of saying "these are not the pages you are looking for".
by yakubin 4y ago
The web is a public space. There are no doors.
Robots.txt is a way of saying "these are not the pages you are looking for".