3 ms·You can rate-limit asynchronous crawlers too.by zeroxfe 10y agoYou can rate-limit asynchronous crawlers too.