3 ms·
> can we just wait out a decade or so of storage improvements before this becomes a non-issue? I'm not sure that there is anything on the horizon which would m
by didgetmaster 4y ago
> can we just wait out a decade or so of storage improvements before this becomes a non-issue?
I'm not sure that there is anything on the horizon which would make duplicate data a 'non-issue'. Capacities are certainly growing, so within a decade we might see 100TB HDDs available and affordable 20TB SSDs. But that does not solve the bandwidth issues. It still takes a long, long time to transfer all the data.
The fastest HDD is still under 300MB/s which means it takes a minimum of 20 hours to read all the data off a 20TB HDD. That is if you could somehow get it to read the whole thing at the maximum sustained read speed.
SSDs are much faster, but it will always be easier to double the capacity than it is to double the speed.
- fragmede 4y agoThe problem isn't the technology, it's the cost. Given a far larger budget, you wouldn't run the hard drives at anywhere near capacity, in order to gain a read speed advantage by running a ton in parallel. That'll let you read 20 TB in a hour if you can afford it. Put it this way; Netflix is able to do 4k video and that's far more intensive.