2 ms·
Google have infrastructure to to serve billions of requests per second, that is not be needed if you only serve yourself. Now imagine if every-one would scrape
by z3t4 9y ago
Google have infrastructure to to serve billions of requests per second, that is not be needed if you only serve yourself. Now imagine if every-one would scrape the web as often as Google does. :P
Your mobile phone can run some billions of instructions per second. Now imagine a server case, or a rack. Compute power is very dense. And very cheap.
The entire wikipedia (text only) can be stored on a micro-sim. eg a few mm.
- ttsda 9y agoYou probably meant micro-SD. And the amount of text content contained in Wikipedia is an atomically sized drop in the Internet's ocean.