3 ms·
Disclosure: I currently work at AWS and have a bit more than passing familiarity with large scale storage systems. I know what erasure encoding is. I know from
by donavanm 10y ago
Disclosure: I currently work at AWS and have a bit more than passing familiarity with large scale storage systems. I know what erasure encoding is. I know from experience just how wrong things can go.
The passing comment of distribution of errors is important. However the "1 stripe is 100Mb, and objects are 10KB, ergo you'll lose 0 or 10,000 objects" bit is bizarro. I suspect youre letting your personal experience lead to assumptions that may not be true in other implementations.
- klodolph 10y agoYes, that's definitely not true on all the storage systems I've worked on. Some storage systems will pack a single customer's data into a single stripe and others won't.