3 ms·
> The Internet Archive can persist the data for ~$2/GB in perpetuity No they can't but do you have a source?
by vasco 1y ago
> The Internet Archive can persist the data for ~$2/GB in perpetuity
No they can't but do you have a source?
- toomuchtodo 1y agohttps://help.archive.org/help/archive-org-information/ https://help.archive.org/help/archive-org-information/ and first hand conversations with their engineering team > We estimate that permanent storage costs us approximately $2.00US per gigabyte. https://webservices.archive.org/pages/vault/ https://webservices.archive.org/pages/vault/ > Vault offers a low-cost pricing model based on a one-time price per-gigabyte/terabyte for data deposited in the system, with no additional annual storage fees or data egress costs. https://blog.dshr.org/2017/08/economic-model-of-long-term-storage.html https://blog.dshr.org/2017/08/economic-model-of-long-term-st...
- dmoy 1y agoWhat's the read throughout to get the data back out, and does it scale to what you'd need to have N search indexes building on top of this shared crawl?
- adgjlsfhk1 1y agothey could charge data processing costs for reads