3 ms·Cloudflare extends robots.txt to separate AI input and AI training use cases2 points by ripe 11mo ago