4 ms·Until you get misbehaving users crawling every page.by lmz 5y agoUntil you get misbehaving users crawling every page.userbinator 5y agoRate limiting works, and isn't discriminatory against "non-standard" clients.