4 ms·
> If you have no robots.txt file then it's an open question. Only for definitions of explicit I must be unfamiliar with. If the presence of a robots.txt makes
by __jal 9y ago
> If you have no robots.txt file then it's an open question.
Only for definitions of explicit I must be unfamiliar with.
If the presence of a robots.txt makes one's intent for a given resource explicit one way or the other, the lack of one (and the lack of some communication in some other channel) must mean there is no explicit permission.