3 ms·
Shameless plug: https://github.com/dandavison/chronologer https://github.com/dandavison/chronologer runs a benchmark (using hyperfine) over every commit in a re
by Myrmornis 6y ago
Shameless plug: https://github.com/dandavison/chronologer https://github.com/dandavison/chronologer runs a benchmark (using hyperfine) over every commit in a repository (or specified git revision range) and produces a boxplot-time-series graph using vega-lite. It works but is rough and I haven't tried to polish it -- does another tool exist that does this?
- The_Amp_Walrus 6y agoThis is interesting. I'm working in epidemiological modelling atm and something this would be pretty useful to run in a github action CI-style to find performance regressions over time. I did a quick Google and found this: https://github.com/marketplace/actions/continuous-benchmark https://github.com/marketplace/actions/continuous-benchmark
- mhh__ 6y agoThis is something that I've been meaning to work on for a while - I'm doing a hardware project ATM so it won't be for a while - but there seems to be a strong use case for a generic software-tracker app. Lots of projects have "are we fast yet" type graphs but I'm not aware of a generic tool that also allows you to set alerts for fine grained benchmarks (I made a toy that alerts you to x-sigma increases in cache misses when testing compiler backend patches for example). One of those projects that I actually want to build but slightly too dull to finish.