6 ms·

You should always be comparing best case for this kind of thing. Slower cases are most likely "your thread got switched out by the OS to let something else run

by Vendan 10y ago

You should always be comparing best case for this kind of thing. Slower cases are most likely "your thread got switched out by the OS to let something else run", and that's not really a fair test.

qznc 10y ago
If you want to guard against context switches by the OS, don't use stuff that "most likely" works. Measure with perf and let it count the context switches.
zamalek 10y ago
Which is why you use 90th percentile.
- to3m 10y ago
  What's wrong with using the best result? If you're concerned the code could run faster than possible: don't be :)
  - bArray 10y ago
    What if the test data is random? Could just get lucky and get a happy day scenario.
    - Vendan 10y ago
      Then both versions should get that "happy day"? If you are using distinct random data for each version, then you aren't really benchmarking properly.
      - bArray 10y ago
        It doesn't say that they both use the same data sets.
        Vendan 10y ago
        If they are using different data sets, then I'd say it's an invalid benchmark.