4 ms·
My question: how can you be sure the output is correct?
by boppo1 4y ago
My question: how can you be sure the output is correct?
- deleted 4y ago[deleted]
- OJFord 4y agoHow can you be sure human output is correct?
- fncivivue7 4y agoMotivation.
- greesil 4y agoHave the AI write a unit test for the human.
- roflyear 4y agoI mean, you can't exactly say "AI, we're having this vague problem, can you go figure it out?"
- demux 4y agoA few hours from some expert consultants. Much cheaper than a dev team coding it up from scratch.
- kolinko 4y agoTests.
- sesm 4y agoTests can prove the presence of the bug, not the absence of them. '100% code coverage' is only 100% in code dimension, while it's usually almost no coverage in data dimension. Generative testing can randomly probe the data dimension, hoping to find some bugs there. But 100% code and data coverage is unrealistic.
- nerdponx 4y agoTraining a machine learning model is not particularly special from a programming perspective. The code is not usually that complicated. Write tests when you can, manually validate when you can't. Also there are specific techniques for validating that you are model training procedure is directionally correct, such as generating a simulated data set and training your model on that.
- risyachka 4y agoAll codebase will need to be covered in unit tests, otherwise AI code is pretty much useless I'd assume
- fathrowaway12 4y agoSame as you would with your own code. You review it, ask GPT to write tests, and then tweak it. The difference is that now, you are more of a code reviewer and editor. You don't have to sit there and figure out the library interface and type out every single line.