2 ms·
While not uncommon, the performance variation of most of these virtualized instances is so high that your numbers are probably within the range of acceptable er
by DannyBee 12y ago
While not uncommon, the performance variation of most of these virtualized instances is so high that your numbers are probably within the range of acceptable error.
(For reference, I have a team that does nothing but maintain a performance benchmarking harness and test lab, so i know these things pretty cold :P)
I also don't see that the benchmarks were even run multiple times.
I tried to follow the ruby-benchmark-suite all the way down the rabbit hole, but don't see anywhere it runs benchmarks multiple times, let alone gives you the variability, etc.