17 ms·

Looks like it's DWiki, which is a python wiki. An uncached page load took 571ms, ICMP latency is 100ms. Frontend server is Apache, forcing a Connection:close on

by raggi 4y ago

Looks like it's DWiki, which is a python wiki. An uncached page load took 571ms, ICMP latency is 100ms. Frontend server is Apache, forcing a Connection:close on every serve (may actually be an advantage against the bot, unless it is also fetching the assets). Whichever way you cut that, if this happens to be a single host server, you're rapidly approaching a core-day with this load once you add some logging and such on top.

lfodofod 4y ago
>Whichever way you cut that, if this happens to be a single host server, you're rapidly approaching a core-day with this load once you add some logging and such on top. No way a scraper running at less than 1rps is anywhere near a core-day without some horrible misconfiguration, it should be way easier to address that than to fight a war against scrapers. I have significantly more complicated flask sites handling 100+ rps on a single core, it doesn’t require any black magic.