3 ms·
There is a YouTube video about a content creator who got a huge AWS bill out of byte spider (bytedance's scraper) indexing his site incredible numbers of times.
by themoonisachees 2y ago
There is a YouTube video about a content creator who got a huge AWS bill out of byte spider (bytedance's scraper) indexing his site incredible numbers of times.
- Nextgrid 2y agoOr maybe just don't host your stuff in such a way that any internet user can bankrupt you just from sending GET requests?
- matthews2 2y agoIf GET requests increase my AWS bill, does that make them not idempotent any more?
- qup 2y agoThis sounds like a scoping issue
- herbst 2y agoThis so much. While it's annoying to waste resources for nothing. All I really had to do to make this a non issue is upgrading my VPS to a slightly larger box. If I would pay per requests I couldn't sleep anymore