2 ms·
For latencies I'd want to see percentiles. Mean / standard deviation are pretty much useless for comparison. With percentiles I can get a good idea of the distr
by nvarsj 9y ago
For latencies I'd want to see percentiles. Mean / standard deviation are pretty much useless for comparison. With percentiles I can get a good idea of the distribution. And with things like HdrHistogram it's easy to measure.
The point of confidence intervals in TFA is to determine whether there are statistically significant differences - but I think they must be making their own assumptions about the underlying distribution to come up with the CIs. So not sure how much I'd trust it.
- scott_s 9y agoPercentiles are ideal. But when you want to report the results of 34 experiments in less than a quarter of a column (see Table 2 referenced above), you gotta make some simplifications.