4 ms·
> it clearly was not obvious how to block or challenge AI crawlers https://xeiaso.net/notes/2025/anubis-works/ https://xeiaso.net/notes/2025/anubis-works/
by cratermoon 2y ago
> it clearly was not obvious how to block or challenge AI crawlers
https://xeiaso.net/notes/2025/anubis-works/ https://xeiaso.net/notes/2025/anubis-works/
- majorchord 2y agoSetting the user-agent to curl (and maybe others) completely bypasses anubis.