4 ms·
All those things are susceptible to the same issue: the ML model can generate test cases and error messages that are convincing to you and me regardless of whet
by Salgat 4y ago
All those things are susceptible to the same issue: the ML model can generate test cases and error messages that are convincing to you and me regardless of whether they're actually right. Don't get me wrong, ML will reach a point someday where it catches up to humans in this respect; this is merely a shortcoming of today's ML, not tomorrow's, and it highlights where ML's weaknesses currently lie (in contrast to more vaguely defined goals like artwork).
- mountainriver 4y agoYup the next iteration of ML needs to focus more on proofs. Okay you know this but how do you know it, show me the proof
- Salgat 4y agoIt's about refining the approximations it makes until those approximations are too tiny/negligible to create failures in code.
- visarga 4y agoIt doesn't work in "closed book" form, the only way you can do that now is to have good tests and let the language models try many attempts.