3 ms·
How do you prevent question misinterpretation, with possible non-evident bad results? (E.g. a complex question would have '42' as correct return value, but mis
by mdp2021 4y ago
How do you prevent question misinterpretation, with possible non-evident bad results?
(E.g. a complex question would have '42' as correct return value, but misinterpretation has the engine return '345'.)
- dan_lupashku 4y agoWe're not doing this yet, but we're working on finding a solution. Any ideas/suggestions?
- mdp2021 4y agoI would need more time for an analysis, but the standard idea would be to make the path-to-solution explicit, verifiable ("also tell us how you got to that"). In other terms, "avoid the black box". Maybe have the generated SQL query output... But this will not impede abuse from lazy users, and errors "may have consequences". Databases (just think of the testing infrastructure for SQLite) are made to be fully reliable; if the interface were not so, you would have broken the model.
- dan_lupashku 4y agoYes, that was what we were thinking about when starting but we didn't want users to abuse our service. However, I'm sure that we'll find a solution soon enough.
- mdp2021 4y agoIssue is, you need not mitigation but certainty (for normal database operation). The quickest path could be having a testing environment set to determine a tentative value for your failure rate, declaring it to the public and declaring in your disclaimer the scope of the your product.
- dan_lupashku 4y agoYes, we'll do this