3 ms·
Python's hypothesis did coverage guided property-based testing for a bit. They turned it off (not sure if they turned it on again): the problem is that propert
by eru 5y ago
Python's hypothesis did coverage guided property-based testing for a bit.
They turned it off (not sure if they turned it on again): the problem is that property based tests of the kind implemented with hypothesis are mainly supposed to be run as part of your CI/CD test suit. So they should be fast.
Coverage guided fuzzing like AFL does usually takes longer than people are prepared to wait for in their build/test server.
- zhd 5y agoI've recently launched HypoFuzz - https://hypofuzz.com/ https://hypofuzz.com/ - which solves this by running it on a different server. You run the tests briefly in CI to check for regressions, and then leave them running permanently on a fuzz server to search for new bugs. Nelson Elhage has a good writeup of this approach at https://blog.nelhage.com/post/two-kinds-of-testing/ https://blog.nelhage.com/post/two-kinds-of-testing/
- eru 5y agoAwesome!