2 ms·
Is it though? If I made changes that broke something surely I would want to know everything that broke rather than just the first test in an arbitrarily ordered
by diab0lic 13y ago
Is it though? If I made changes that broke something surely I would want to know everything that broke rather than just the first test in an arbitrarily ordered set of tests!
Though I like your style, very simple, and simple is good. The state is binary, tests are passing or they are not. Unfortunately in this particular reality the added complexity of knowing all broken tests can prove very useful.
- silentbicycle 13y agoKnowing that a change broke a specific set of tests tells you a lot more than knowing it broke the first one of them that happened to run. If I'm using fuzzing to run thousands of tests, and all the ones whose seed led to the same specific bit pattern are failing, that's particularly useful information. I found a particularly subtle bug in heatshrink (https://github.com/atomicobject/heatshrink https://github.com/atomicobject/heatshrink) that way, but a single failing test would have looked like noise.