3 ms·
> By not telling us the specifics and by killing the repeatability of this benchmark, you can only say with a minimal amount of certainty that the dedicated ha
by teej 17y ago
> By not telling us the specifics and by killing the repeatability of this benchmark, you can only say with a minimal amount of certainty that the dedicated hardware improved performance.
I can agree that this test only has a small amount of certainty that actual performance of the application was higher on the new hardware. So what? It's is possible to use correlated metrics, such as engagement, time on site, and pageviews per user to determine if the move was "successful".
37signals' end goal was most likely to -improve user experience-. If you can confidently say that a valid random sample of users on A servers have a better experience than those on B servers, raw speed numbers don't matter.
I guess my point is: Test everything on your own. In the end, it's your users happiness that matters the most, not server speed.