4 ms·
Presumably due to https://neatnik.net/robots.txt https://neatnik.net/robots.txt
by lucb1e 3y ago
Presumably due to https://neatnik.net/robots.txt https://neatnik.net/robots.txt
- deleted 3y ago[deleted]
- 77pt77 3y ago> User-agent: ia_archiver > Disallow: / Denied!
- flexagoon 3y agoWow, thanks for pointing that out, that made me never want to join omg.lol
- lucb1e 3y agoThat's not present on another omglol site that was linked elsewhere in the thread, though. I would agree with you if they automatically set this for everyone. I'm not sure how come that other sites aren't showing up in the archive. (I'm not a customer of theirs or anything, I'm already hosting my own stuff)