3 ms·
That feels like an issue to be solved by the tests. If a program conforms to the public test suite the program "works" or the tests aren't covering the specific
by staticassertion 5y ago
That feels like an issue to be solved by the tests. If a program conforms to the public test suite the program "works" or the tests aren't covering the specification.
- johncolanduoni 5y agoFor compression tests it's a little different, since the problem is often underdefined even for a fixed algorithm and different implementations may produce encodings with different efficiencies (space, compression time, decompression time) for different inputs. Compression implementations can overfit on some inputs and produce subpar results on average even if they produce valid outputs for all inputs. However I doubt this applies to coreutils' tests, which I suspect are more about conformance.
- staticassertion 5y agoThat makes sense if the public tests are "compress these bytes, expect this output" but I'd expect instead to have a lot of specific components with their own individual tests.