4 ms·
The bit about the large repositories reminds me tangentially of something I read about Amazon: when tuning for performance, they don't look at, say, the median
by wpietri 12y ago
The bit about the large repositories reminds me tangentially of something I read about Amazon: when tuning for performance, they don't look at, say, the median response time. They look at the 99.9% level.
If I recall rightly, their example was a customer searching their old orders. The customers with the slowest response times were their very best customers, and they wanted those people to have at least as good as an experience as the median customer.
That definitely change my attitude to performance tests: now whenever I'm picking metrics, I think hard the real-world implications of the levels I'm setting.
- sytse 12y agoVery true, and you can be sure we'll pay a bit more attention to the 0.1% biggest repositories from now on.
- res0nat0r 12y agoYup, AWS uses this metric everywhere (TP99). If 1% of your requests take 1000% more time than everything else, then you need to optimize and ensure this doesn't screw everyone. Here is a bit more info: http://codesith.blogspot.com/2012/06/tp99.html http://codesith.blogspot.com/2012/06/tp99.html