In general we recommend to run tests all the time. Machines are cheap compared to developers and you can add as many runners as you want. What you can also do

In general we recommend to run tests all the time. Machines are cheap compared to developers and you can add as many runners as you want. What you can also do is use project or system hooks to trigger CI via the new build API that will be available on August 22. Another option is to skip builds, you can just add [skip ci] to your commit message, and next build will be skipped.