2 ms·
> will make things slower and flakier. If running tests with different data makes them flaky, your system is bad. Regardless of property based testing, I've s
by troupo 3y ago
> will make things slower and flakier.
If running tests with different data makes them flaky, your system is bad.
Regardless of property based testing, I've seen too many systems where there were hundreds of unit tests and which wold fail for the most trivial reasons because the actual integration of those units was never tested properly.
- agentultra 3y agoI love PBT and use it frequently. So integration tests are generally IO-bound. They'll be slow. With PBT you will generate 100, 1000 slow cases. Integration tests are flaky in the sense that your components might not generate just the right inputs to trigger an error. They may not be configured under test the same way as they are in production. And so on. PBT can be flaky in the sense that, even with carefully selected distributions, you can get a test that ran fine for months to fail on a run. Add that on top of integration test flakiness. There's no silver bullet for writing bad specifications.