3 ms·
So, there was an earlier attempt at a preservation storage system with a "pay up front to fund perpetual storage", called the "Digital Preservation Network". I
by jrochkind1 7y ago
So, there was an earlier attempt at a preservation storage system with a "pay up front to fund perpetual storage", called the "Digital Preservation Network".
It came out of the library and archive sector, and focused on institutional customers -- libraries and archives with long-term archival/preservation needs. It was also non-profit. It of course seems attractive, if you really want to ensure long-term preservation, to set up a financial model that can somehow do this independent of the risk of the business continuity and budgets of the original depositors. And for cultural heritage institutions -- in the business of preserving incrementally more stuff every year -- it's a big advantage to budgeting if you can budget per GB you add to preservation storage up front, and never have to pay for it again -- so your yearly budget for preservation storage is just based on number of NEW TB's you are adding, instead of constantly going up with total number of TB's preserved, and thus this portion of your budget stays pretty constant instead of ever-increasing.
However, the DPN folded in Dec 2018, after fewer than 5 years of operation. It did not attain financial sustainability. (So all those up-front fees did not end up paying for perpetual storage after all).
You can read more about it's shutdown here:
https://duraspace.org/the-digital-preservation-network-dpn-to-cease-operations/ https://duraspace.org/the-digital-preservation-network-dpn-t...
https://scholarlykitchen.sspnet.org/2018/12/13/digital-preservation-network-disband/ https://scholarlykitchen.sspnet.org/2018/12/13/digital-prese...
This new attempt is focusing on consumer/retail rather than institutional customers. A different scale of market (and by their suggested pricing tiers, aiming for much less storage per-customer).
And there is at any rate no reason to think just because one effort failed another will have to. Not every try ends up at the same outcome.
But I'd think the story of that effort should hopefully be informative for this new one. I think it's not a trivial thing to succeed with this sort of business model. I'd find it a bit more reassuring if they were like "Here are people who have tried this before, and why we think we will succeed." Although the answer to that might just be "an endowment model".
I think the permanent.org website is engaging in a bit of marketing slight of hand when they say "We are leveraging the same funding models used by museums, libraries and universities for centuries." -- making it seem like this is a solved problem, we're just doing what's worked for centuries for libraries and museums!
There's really nothing specific to libraries, museums, or universities about "endowments". Non-profits of all sorts would love an endowment. (and maybe some for-profits somehow?) I know of few libraries, museums or universities whose entire operating budget is paid out of an endowment. Most institutions even with endowments (and not all do) need to seek ongoing funding or revenue for operations in addition to the endowment.
Only the wealthiest even approach it. Generally there is a correlation between how much of operating budget is endowed and how old the endowment is. "For centuries" indeed -- those institutions with the biggest endowments generally have centuries-old endowments, created by extremely wealthy people long ago. I think there are probably few, if any, examples of recently-created endowments funding all or most of the operating budget of non-tiny institutions. Let alone endowments created by aggregating fees from "customers" paying for service, instead of wealthy benefactors.
And of course, there is the different business here too, the need to be able to predict ongoing operational costs not just of hardware, and things like electricity and space and networking, but of course the staff time that we all know is a non-trivial component of most IT projects. And the need to be doing it competently, with effects on both budget and success at not losing data!
I think it's rather too hand-wavy to imply (and i think that is defintely meant to be the implication) "Oh, this is the model that libraries and museums have used for centuries to do similar stuff, so of course it's proven!"
That said, the model is certainly attractive if it works! It is hard to imagine ensuring very-long-term preservation with a business model that requires the content-donors to keep paying perpetually. (also a non-profit model seems appropriate to me for very-long-term preservation).
(I am a librarian/software engineer whose work includes archival materials and digital preservation).
- hosh 7y agoThis is probably the most well-thought-out comment here. It isn't a knee-jerk "it isn't permanent", "the tech won't work", "the funding won't work". I'm not looking at this from the lens of an archivist, though I think that is important too. What do you think about the role of IPFS and FileCoin in digital preservation? Is there a role?
- jrochkind1 7y agoThanks! I don't personally think very much of one, but i'm pretty down on blockchain in general. (Also not an expert at it, only have a surface-level IT guy understanding of it). I could see some role in using blockchain to keep track of _checksums_ of preserved files (nothing in the chain except the cryptographic digests of files stored elsewhere), as a way to have a hard-to-tamper-with multi-party-decentralized preserved historical record that a particular file was stored at a particular time, and has not changed since (whether from error or mal-intent). Just a record of what was stored when, not otherwise involved in the storage itself. If you want decentralized multi-party storage (which is cool, but I'm not sure it's necessary), there are protocols for that which don't require, or IMO have any reason to benefit from, blockchain technology. Again just my own not super well-informed opinion, and I'm hardly a blockchain expert (being pretty suspicious of it).
- hosh 7y agoAwesome, thank you for engaging :-) Let me see if my quick run-down here might spark something interesting. IPFS itself is not a blockchain. It is a piece of distributed infrastructure that allows people to share and store content in a distributed way. There are parts of it that are similar to the old torrent protocol. The main thing with IPFS is that the people who care about keeping a particular piece of data alive can "pin" it locally on their servers. Everyone accessing it will query other people who have pieces of that content -- just like with bittorrent. IPFS has no monetization or blockchain. FileCoin is the blockchain. It was intended to be the blockchain run on top of IPFS, although it may work on other content storage/transfer schemes. The idea with that blockchain is built around "proof of storage". That is, I can request someone store some bit of data for me, and you can offer to store it in exchange for something of value. Among one of the immediate things I wanted to apply IPFS to is this archive of digital material that contains a knowledge base for our current technology base. I have since lost track of that knowledge base. It was designed as a CD you can burn, and get all sorts of information. The idea was to preserve this information in case of something catastrophic happening to our civilization. One thing about IPFS, and perhaps FileCoin, is that it allows for decentralized knowledge bases. Stuff that could be administrated at a local, community level, and yet federated with many communities. An example: gardening. With the pandemic, there had been a lot of people interested in gardening for the first time. However, how you plant, what you plant, how you manage those things are depended upon local conditions. I live in the low desert, and what I need to do for here is different from my friend who live in the high desert, or in the SE US.