3 ms·
Is it really worth optimising the test runs in this way? The potential for making a mistake in the test resource specifications is huge. Sure, you might save a
by joosters 7y ago
Is it really worth optimising the test runs in this way? The potential for making a mistake in the test resource specifications is huge.
Sure, you might save a few minutes per test run, but at the cost of buggy, unreproducible tests that fail at random due to interactions with other ones running in parallel. Tests need to be reliable and developers need confidence that the tests work and that failures are real.
- setr 7y agoI can't imagine it being that difficult to verify correctness of the changes -- just compare the results of the original test suite, and the results of the parallel one -- and try this repeatedly until you're confident you've avoided any missed specifications If the parallelism actually speeds things up, repeated runs shouldn't be too painful :-)