4 ms·
I think there’s a difference between crawling websites at a reasonable pace instead of just hammering the server to the point it’s unusable. Nobody has problem
by navanchauhan 2y ago
I think there’s a difference between crawling websites at a reasonable pace instead of just hammering the server to the point it’s unusable.
Nobody has problems with the Google Search indexer trying to crawl websites in a responsible way
- 23B1 2y agoFor sure. I'm really just pointing out the inconsistent technocrat attitude towards labor, sovereignty, and resources.