4 ms·
Towards parallel kernel test runs
- setheron 7y agoWhy doesn't Linux tests auto run in qemu or even UML. UML sounds perfect for unit testing the kernel without having to install it. I feel like there's a chance to narrow the gap in a lot of CICD practices missing in the kernel.
- amluto 7y agoUML is different enough than normal Linux to make this have dubious value. KVM is fast. I personally test with virtme, but I haven’t set things up to automatically run the selftest suite. https://github.com/amluto/virtme https://github.com/amluto/virtme
- myroon5 7y ago"The naive solution is obviously to run $NCPU+1 tests in parallel. But there is a catch, some of the tests utilize global system resources or state and running two such tests in parallel would lead to false negatives." Couldn't multiple test environments run even these tests in parallel?
- joosters 7y agoIs it really worth optimising the test runs in this way? The potential for making a mistake in the test resource specifications is huge. Sure, you might save a few minutes per test run, but at the cost of buggy, unreproducible tests that fail at random due to interactions with other ones running in parallel. Tests need to be reliable and developers need confidence that the tests work and that failures are real.
- setr 7y agoI can't imagine it being that difficult to verify correctness of the changes -- just compare the results of the original test suite, and the results of the parallel one -- and try this repeatedly until you're confident you've avoided any missed specifications If the parallelism actually speeds things up, repeated runs shouldn't be too painful :-)