3 ms·
The looming (storage) bandwidth wall
- obecalp 17y agoRetrieving data to process and storing back to some giant "storage units" are becoming more and more obsolete. The future is google style: data is replicated and backed up at all times and you push computation to data to explore data locality.
- pronoiac 17y agoMitigate this by keeping redundant copies on multiple servers, avoiding having similar servers with largely the same set of chunks.