2 ms·
> a crawl requesting about 2 pages per second. It was so intense [...] Do 2 pages per second really count as "intense" activity? Even if I was hosting a websit
by dns_snek 2y ago
> a crawl requesting about 2 pages per second. It was so intense [...]
Do 2 pages per second really count as "intense" activity? Even if I was hosting a website on a $5 VPS, I don't think I'd even notice anything short of 100 requests per second, in terms of resource usage.
- BrutalCoding 2y agoI assumed that he meant per client. Having a limit of 2 pages a second for a single client seems like a reasonable amount to me.
- gtirloni 2y agoIf ypu open DevTools and visit any website these days, you'll be surprised.
- otherme123 2y agoIn my scenario you request one single page from the proxy endpoint, and all other requests go straight to the static files and have no limits. I know than no human needs to request more than 1/s from the proxy, unless you are opening tabs frantically. So far, I only get praises about how responsive and quick the sites are: being harsh with the abusers means more resources for the regulars.
- dns_snek 2y agoDownvoted for asking a completely reasonable question? Where am I?