3 ms·
A number of the assumptions in the paper are questionable in hindsight. Disk bandwidth consistently exceeds network bandwidth by a significant factor in common
by jandrewrogers 11y ago
A number of the assumptions in the paper are questionable in hindsight.
Disk bandwidth consistently exceeds network bandwidth by a significant factor in common systems and this is likely to be the case for the foreseeable future. A platform with a good I/O scheduler can easily and demonstrably turn that into extra throughput on the same hardware for many use cases.
Their corroborating examples are platforms that happen to have poor I/O scheduling. In these cases, the effects of poor I/O schedules would be expected to dominate the effects of differences in bandwidth. You would expect the differences in available bandwidth to have no practical effect as a result. But there are many platforms that do implement good I/O schedulers where differences in bandwidth materially affect performance because the I/O schedulers can take advantage of that bandwidth.
While not entirely their fault, their assumptions about the cost of SSDs is incorrect. The difference in cost/GB is down to a relatively small integer factor and shrinking, well under a single order of magnitude. And these can deliver enormous local bandwidth in cheap systems. In many cloud clusters now, the cost of a large, local SSD JBOD (how you would want to use it) is less than the cost of the server, even with cheap servers. The cost of using SSD over spinning disk has become increasingly marginal for many applications.
In summary: platforms with good I/O schedulers see real benefits to disk locality, assuming the application is I/O intensive. Platforms with poor I/O schedulers not so much. Make the appropriate choice for your use case and platform.
- vidarh 11y agoThe thing that struck me is that they are looking at what networks are available. But to date I've never worked on a single system using 10GbE or above. Of course they are out there in large numbers within specific niches. But most people are still stuck on 1Gbps. At the same time a steadily increasing proportion of those systems have SSDs which can do 2GB/sec+ reads.