3 ms·
Yeah. After I saw the bot I added it to my robots.txt and I blocked all of Cloudflare's IP ranges to the server. But the bot had already come and gone. And the
by superkuh 10y ago
Yeah. After I saw the bot I added it to my robots.txt and I blocked all of Cloudflare's IP ranges to the server. But the bot had already come and gone. And the email I'm waiting back on from Cloudflare is about what to put in the robots.txt since it's not on the FAQ page. As of right now I'm trying,
User-agent: Cloudflare-AMP
Disallow: /