4 ms·
Sounds like an outrageously dangerous place to roll your own system. What you're describing is some sort of reed-solomon type data recovery, though I've absolut
by nwh 13y ago
Sounds like an outrageously dangerous place to roll your own system. What you're describing is some sort of reed-solomon type data recovery, though I've absolutely no idea how that would work in practise. Wouldn't you be spending all of your time updating the parity information?
- nanch 13y agoYes, similar to reed-solomon/tornado codes in theory - being able to recover from lost data; but closer to RAID 5 in practice. I'm familiar with tornado codes, but that's beyond the scope of v1 for this. Updating parity wouldn't be as much of a concern because real-time backups are not a requirement - getting a "snapshot" from each server at a current time would be enough; and we'd be able to recover to that snapshot. For v1 I would assume no data is ever deleted from a server, so a recovery would from a single server failure would be possible. (but this is where additional redundancy would be useful via RS/tornado codes).