2 ms·
> Automatic testing will still work because a developer isn't going to add restrictions to their own tests from their site. Unless they are testing if a captcha
by account42 3y ago
> Automatic testing will still work because a developer isn't going to add restrictions to their own tests from their site. Unless they are testing if a captcha gets shown from an unsafe environment.
Websites aren't the only party that might want automated tests.
> Archives, search engines, and spiders should already be respecting robots.txt. Site owners can already block those things if they don't want their site crawled.
robots.txt is not law. Archives, search engines, and spiders SHOULD ignore it in cases where they deem it the more moral action. After all, all of these are supposed to snapshot the web that humans see.