I fail to see how anyone can create a repeatable objective benchmark between different VPS providers. I respect the fact that the author tried hard and didn't

I fail to see how anyone can create a repeatable objective benchmark between different VPS providers. I respect the fact that the author tried hard and didn't bias the results, but I fail to see where he even repeated the benchmark over a number of days to attempt to eliminate variations in what the other guests were doing while the benchmark was running. As I see it, the only way I would trust a benchmark of this nature was if it was somehow ran over multiple hosts and was able to sample a large fraction of the physical boxes over a large period of time. As you can image, that's impossible to do on S3 and any of the other larger VPS providers Even if somehow someone did manage to pull off a benchmark like the above, I still wouldn't trust it because it would only be valid until the provider added "Joe's Cheap Video Encoding Service" as a client that's sharing my box. Or someone else who's running a benchmark just like you are? With all of the above said: I'm sure that there is differences between the VPS providers in how they allocate CPU and IO resources and Digital Ocean may indeed be much better on average. I'm just not sure how you can measure it objectively to make sure they are or that they will continue to be so even 5 minutes in the future. Which is a shame, because an objective metric that was trustworthy that compared all the different providers would be absolutely awesome.