Great article and sleuthing to find the information. I know you're processing them dynamically as they come in and break the rules. But if you wanted to supple

Great article and sleuthing to find the information. I know you're processing them dynamically as they come in and break the rules. But if you wanted to supplement the list, might be worth sourcing the ones from https://github.com/ai-robots-txt/ai.robots.txt https://github.com/ai-robots-txt/ai.robots.txt at some frequency.