3 ms·
I suppose a big part of the storage problem he talks about is solved by agressively looking for duplicate and similar files over users. I mean, it is a given th
by wladimir 16y ago
I suppose a big part of the storage problem he talks about is solved by agressively looking for duplicate and similar files over users. I mean, it is a given that a lot of people will be bookmarking the same sites.
- mikeklaas 16y agoYes, but they will be also bookmarking a lot of stuff that only they bookmark. In our dataset of over a billion bookmarks, 80% of urls were only bookmarked by a single user. These urls comprise about 50% of all bookmarks (user-document pairs). Incidentally, worio.com (my startup) offers full-text search of your bookmarks (though not a viewable cached copy, like these services).
- bruceboughton 16y agoI'd bet the %age of external resources referenced by bookmarked pages that were unique to a user would be a lot lower... which is where the aggressive de-duplication would come in handy.
- riffraff 16y agoit's not only the same sites. It is probable that a lot of included content: javascript libraries are the same very often, header images, backgrounds, stylesheets, facebook/google/yahoo/twitter icons for various connect-like services, same youtube videos get published in many places etc. There is a lot common across different pages I believe.