3 ms·
robots.txt and dmca seems appropriate
by x0x0 10y ago
robots.txt and dmca seems appropriate
- DanBC 10y agoDoesn't DMCA have specific exemptions around caching.
- x0x0 10y agomy understanding is possibly, but not in violation of robots.txt
- superkuh 10y agoYeah. After I saw the bot I added it to my robots.txt and I blocked all of Cloudflare's IP ranges to the server. But the bot had already come and gone. And the email I'm waiting back on from Cloudflare is about what to put in the robots.txt since it's not on the FAQ page. As of right now I'm trying, User-agent: Cloudflare-AMP Disallow: /