3 ms·
Then maybe we need laws about crashing my server by crawling it 163,000 times per minute nonstop, ignoring robots.txt? Until then, no pity for the bots.
by dmitrygr 1y ago
Then maybe we need laws about crashing my server by crawling it 163,000 times per minute nonstop, ignoring robots.txt? Until then, no pity for the bots.
- jillyboel 1y agoif your software crashes due to normal usage then you only have yourself to blame
- dmitrygr 1y agoYes indeed. Nginx running out of RAM due to A”I” companies hammering my server is my fault.
- jillyboel 1y agoYes. Fix your configuration so it won't try to allocate more ram than you have. You can still be upset about them hammering your site but if your server software crashes because of it that's a misconfiguration that you should fix regardless.