5 ms·
You can approximate it, but to represent really all properties, in the end it becomes a mirror picture of the actual code you are testing, which then begs the q
by layer8 4y ago
You can approximate it, but to represent really all properties, in the end it becomes a mirror picture of the actual code you are testing, which then begs the question.
A random sample of inputs that is hidden from the AI also won’t allow it to derive a corresponding implementation. And if the set of sample inputs is not hidden, then the AI is still free to produce an implementations that only works for those sample inputs.
- UK-AL 4y agoYou'd probably separate example tests and validation tests. Also test descriptions should fed into the prompt to help guide it, like BDD style tests. On test failure, the data is fed back into the prompt about what failed for another iteration. This will help avoid over-fitting, and generate another generation on test failure. I mean you can't guarantee correctness, but you could probably get it pretty close. Humans also have the same problem.