4 ms·
What happens if say 3 shards of a specific file you need are not online that day? Or never come back online again? I understand the files are copied to multiple
by dubcanada 6y ago
What happens if say 3 shards of a specific file you need are not online that day? Or never come back online again? I understand the files are copied to multiple locations but we are not talking about a 24/7 datacenter but random computers. People can decide to uninstall the program or never power back on or anything.
Unless it’s copied to basically every computer I don’t see how eventually someone would have a corrupted file just because they are unable to piece it back together with available computers.
- PurpleFoxy 6y agoThe solution for this is to require hosts to enter some kind of deposit in to the system. If they go offline too much, the deposit is forfeit.
- ohashi 6y agoBasically what Storj does. I am kind of wondering if they are backed by it based on descriptions
- rglullis 6y agoI confess that I haven't gone deep into Storj, but I am running a node for some weeks now and I didn't have to pay anything (besides the operational costs of keeping the server online, of course) to get into it.
- ClumsyPilot 6y agoYou are earning money every month, but they keep a colateral and payment to you is delayed. If your nodes combusts one day, that colateral dissapears broadly speaking. Also there are like 32 shards for each data, so 32 conpuetrs don't go offline in one day.
- wctwct 6y agoWe now manage a network of over 250,000 NAS devices that are part of our network. So we know how to handle devices going offline without losing data. This approach has been used at scale since 2014.
- onionjake 6y agoWe are planning on releasing more information about this in the future. Using erasure encoding we can copy it to lots of devices, say 60, then only require 25 of those 60 to retrieve the object. If the devices storing data go offline we constantly monitor and refresh the pieces to maintain integrity.