5 ms·
"Each benchmark was run multiple times, and I’m using the median to get rid of any potential outliers." This is not how you should do benchmarks. Don't take th
by stephc_int13 6mo ago
"Each benchmark was run multiple times, and I’m using the median to get rid of any potential outliers."
This is not how you should do benchmarks. Don't take the median, you don't even need to do any "warming up".
Simply run it long enough and only take the best result of each. This is more reliable and correct.
- syncsynchalt 6mo agoThis is not universally applicable, especially if an algo isn't deterministic. For example if you were to time "bogosort of 100 items" you'd see increasingly better times the more runs you performed.