3 ms·
>the whole web is stored in RAM Whoa wait, that can't be totally true? The full text of everything is in RAM? Not just the indexes and whatnot? I guess the tex
by MichaelGG 12y ago
>the whole web is stored in RAM
Whoa wait, that can't be totally true? The full text of everything is in RAM? Not just the indexes and whatnot? I guess the textual information is a small fraction of the total bytes, and some clever compression would make it possible, but wow.
So even at Google scale, some problems are already possible just to put in RAM. (The original Page rank paper spent a bit taking about aiming for 1 seek per lookup.. And my own multi billion record lookup system also found that to be the biggest latency.. But even I'm dealing with at least a TB a day of mostly text protocols and am happy to get the rough indexes into RAM.)
Wow.