4 ms·
Should theoretical research of data structures and algorithms have been capped at 1GB in 1980 because that was the biggest single hard drive available back then
by yes_man 3y ago
Should theoretical research of data structures and algorithms have been capped at 1GB in 1980 because that was the biggest single hard drive available back then and you couldn’t store for example a 2GB dataset on a disk?
- marginalia_nu 3y agoNot at all, I'll still call out fantastic claims when I see them though.
- karpierz 3y agoGoogle has definitely indexed over a trillion pages.
- marginalia_nu 3y agoDo you have any sources for this claim? As far as I am aware Google doesn't publish any statistics about the size of its index, which no doubt varies.
- groby_b 3y agohttps://www.google.com/search/howsearchworks/how-search-works/organizing-information/#:~:text=The%20Google%20Search%20index%20contains,of%20the%20words%20it%20contains https://www.google.com/search/howsearchworks/how-search-work....
- marginalia_nu 3y agoWell what do you know, they contradict the claim made above.
- karpierz 3y agoSorry, they've crawled trillions of pages, and narrowed it down to an index of 100s of billions. Conveniently, the link answers your question of "can you have PB sized indices?" to which we can clearly say, yes.