3 ms·
This would be fine in an ideal world. However, the one we live in has crawlers that don't care how many resources they use. They're fine with taking the server
by maleldil 2y ago
This would be fine in an ideal world. However, the one we live in has crawlers that don't care how many resources they use. They're fine with taking the server down or bankrupting the owner as long as they get the data they want.
- dale_glass 2y agoAnd I can understand the abuse argument, however they have a blanket exclusion for AI I do not agree with.