3 ms·
They absolutely should be paying you if they're single-handedly abusing your resources
by tetris11 2y ago
They absolutely should be paying you if they're single-handedly abusing your resources
- themoonisachees 2y agoThere is a YouTube video about a content creator who got a huge AWS bill out of byte spider (bytedance's scraper) indexing his site incredible numbers of times.
- Nextgrid 2y agoOr maybe just don't host your stuff in such a way that any internet user can bankrupt you just from sending GET requests?
- matthews2 2y agoIf GET requests increase my AWS bill, does that make them not idempotent any more?
- qup 2y agoThis sounds like a scoping issue
- herbst 2y agoThis so much. While it's annoying to waste resources for nothing. All I really had to do to make this a non issue is upgrading my VPS to a slightly larger box. If I would pay per requests I couldn't sleep anymore
- Nextgrid 2y agoOn the other hand the amount of traffic he's mentioning is about 3.4 requests per minute which is effectively background noise. They're probably getting much more hits from actually malicious scanners than Bing's misbehaving spider.