4 ms·
So would the ideal solution be if ScyllaDB had a github action to run benchmarks against PR's? Not sure how decent a benchmark would be without running up serv
by ianpurton 4y ago
So would the ideal solution be if ScyllaDB had a github action to run benchmarks against PR's?
Not sure how decent a benchmark would be without running up servers in the cloud. So I guess provisioning infra would be a requirement?
So perhaps this could be run manually. But certainly possible
- Pulumi up infra
- Run benchmarks
- Collect results
- Attach to PR.
- insanitybit 4y agoI'd be happy with a few things: 1. Benchmarks of "pure" code like the response parser, which I could `cargo bench`. I may actually work on contributing this. 2. Some way to run benchmarks against a deployed server. I wouldn't recommend a Github action necessarily, a nightly job or manual job would probably be a better use of money/resources. If I could plug in some AWS creds and have it do the deployment and spit out a bunch of metrics for me that'd be wonderful.