Just like Cloudflare many providers now just allow blocking: https://www.haproxy.com/blog/how-to-reliably-block-ai-crawlers-using-haproxy-enterprise https://www

Just like Cloudflare many providers now just allow blocking: https://www.haproxy.com/blog/how-to-reliably-block-ai-crawlers-using-haproxy-enterprise https://www.haproxy.com/blog/how-to-reliably-block-ai-crawle... (disclaimer: I wrote this blog post)