4 ms·
The Internet Archive Petabox Storage System
- 0x006A 11y agorather dated by now, would be interesting to see how it evolved lately.
- toomuchtodo 11y agoCurious why the archive isn't using Backblaze's open storage pod design.
- deleted 11y ago[deleted]
- Sanddancer 11y agoBackblaze's design, by their own admission, is good if you have low IO usage. Internet Archive has a much different usage set, where the instantaneous IO needs are higher, and thus, the backblaze design would be way too high latency for them. Things like caching and ECC are much more useful when you have the hot spots that Internet Archive tends to have.
- toomuchtodo 11y agoI get that. Time to first byte isn't critical with the internet archive, and they could use a robust caching later (varnish?) in from of their s3-similar storage system.
- feld 11y agoCloudflare would argue that time to first byte isn't critical, period https://blog.cloudflare.com/ttfb-time-to-first-byte-considered-meaningles/ https://blog.cloudflare.com/ttfb-time-to-first-byte-consider...
- jacquesm 11y agoThe 14 fold increase in capacity in one generation is incredible. There is still quite a revolution going on in storage. Any bets on whether the next generation will still contain spinning media?
- toomuchtodo 11y agoI don't believe spinning disk is long for this world. 6TB SSD drives are already out, the price just needs to be driven down. Much lower power consumption at idle is a side benefit.
- jl6 11y agoWhen you say out, do you mean there is actually one for sale that I could buy today?
- waterhouse 11y agoLooks like there will be one in two months, from a company called Fixstars; the price estimate given in the article (which it calls optimistic) is $1800-$2400. http://www.extremetech.com/extreme/205362-massive-6tb-ssd-hitting-the-market-this-july http://www.extremetech.com/extreme/205362-massive-6tb-ssd-hi...
- scrollaway 11y agoIt's not just about the price and the storage. It's also how reliable they are. A 6tb ssd which fails after 6 month is worthless.
- feld 11y agoWait, they used reiserfs? They wanted to keep their data, right? yow