I've encountered a couple of robots.txt that specifically block popular llms for certain areas. Example: https://www.sigmaaldrich.com/robots.txt https://www.si

I've encountered a couple of robots.txt that specifically block popular llms for certain areas. Example: https://www.sigmaaldrich.com/robots.txt https://www.sigmaaldrich.com/robots.txt