3 ms·
Fuzz testing is based on us knowing that certain kinds of bugs can be triggered by certain kinds of input, even if we don't know the exact details.
by AnimalMuppet 5y ago
Fuzz testing is based on us knowing that certain kinds of bugs can be triggered by certain kinds of input, even if we don't know the exact details.
- thaumasiotes 5y agoNo it isn't. Fuzz testing is based on us knowing that bugs probably exist, and no more than that. The entire concept is that you provide random input and see whether bugs occur. You're not looking for particular kinds of bugs.
- AnimalMuppet 5y agoWe know that programs sometimes expect data with certain relationships between different parts. For example, one part may be a length field, and the program expects that some other part of the data will have that length, and may fail to handle it correctly if the data does not conform to that assumption. Fuzzing is a... well, a slightly-better-than-nothing way of trying to activate that kind of bug. Could fuzzing activate other kinds of bugs? Sure. But it's not magic. It's mostly working on known kinds of bugs.
- thaumasiotes 5y agoYou have some strange ideas about what fuzzing is.
- AnimalMuppet 5y agoIf you know more, you could provide some clarity, rather than just insults.
- ThrowawayR2 5y agoFuzz testing requires a test oracle to tell you whether the output is good or bad. Otherwise, all you're checking for is crashes which is unlikely to yield much.
- ghoward 5y agoYou're partially right. If you put asserts everywhere in your code, to test all assumptions the code has, then fuzzing is an excellent way to see whenever one of those assumptions is violated because those violations are turned into crashes. In my experience, fuzzing with extensive asserts is one of the best way to suss out bugs. It gets even better if you can take all of the paths the fuzzer found and run them through something like ASan or Valgrind. You can read more about that at [1]. [1]: https://git.yzena.com/gavin/bc/src/branch/master/manuals/development.md#user-content-fuzzing-1 https://git.yzena.com/gavin/bc/src/branch/master/manuals/dev...