3 ms·
And the author didn't add ChatGPT Bot to their robots.txt either: https://jamesshelley.com/robots.txt https://jamesshelley.com/robots.txt So they let the good
by altdataseller 3y ago
And the author didn't add ChatGPT Bot to their robots.txt either: https://jamesshelley.com/robots.txt https://jamesshelley.com/robots.txt
So they let the good bot out, and the evil one in
- sotix 3y agoI was under the impression that archive.org doesn’t respect robots.txt, so in this case they’re the evil ones.
- Springtime 3y agoThat's archive.is not .org which does that.
- Gigachad 3y agoIt does. Even retroactively it will remove things previously cached.