3 ms·
It appears helloworld is the only test with any repeats, and it only has 5 repeats. https://github.com/hanabi1224/Programming-Language-Benchmarks/blob/a2e76950d
by cormacrelf 5y ago
It appears helloworld is the only test with any repeats, and it only has 5 repeats. https://github.com/hanabi1224/Programming-Language-Benchmarks/blob/a2e76950d4798906bda99e08e00fd5e9c57f4326/bench/bench.yaml#L18 https://github.com/hanabi1224/Programming-Language-Benchmark... (Also, you can't average out the VM scheduling something else during the test, if it is constantly scheduling other stuff as it is a very busy build machine.)
Here's the measurement code, it appears to be significantly more complicated than a simple fork/exec/wait loop but that could just be all the C# getting in the way: https://github.com/hanabi1224/Programming-Language-Benchmarks/blob/ebed7a407f4dfcc291fb9efab04ca9c80cc70b93/bench/tool/ProcessUtils.cs#L149-L323 https://github.com/hanabi1224/Programming-Language-Benchmark... Note that we are definitely measuring the C# async runtime to some degree. Nevertheless you are probably right that the bulk of this 1.8ms is in the executable under test, and it truly is just bloat. Running `hyperfine ./empty-main-function` from rustc on my Mac gives 0.8ms.
- jart 5y agoLooks like it might be async C# thread sleep code launching bash launching the benchmark.