4 ms·
I believe most people use AI to help them quickly figure out how to use a library or an API without having to read all their (often out dated) documentation ins
by gerash 2y ago
I believe most people use AI to help them quickly figure out how to use a library or an API without having to read all their (often out dated) documentation instead of helping them solve some mathematical challenge
- taeric 2y agoIf the documentation is out of date, such that it doesn't help, this doesn't bode well for the training data of the AI helping it get it right, either?
- macintux 2y agoAI can presumably integrate all of the forum discussions talking about how people really use the code. Assuming discussions don't happen in Slack, or Discord, or...
- randomNumber7 2y agoAnd all the code on which it was trained...
- woodson 2y agoUnfortunately, it often hallucinates wrong parameters (or gets their order wrong) if there are multiple different APIs for similar packages. For example, there are plenty ML model inference packages, and the code suggestions for NVIDIA Triton Inference Server Python code are pretty much always wrong, as it generates code that’s probably correct for other Python ML inference packages with slightly different API.
- jon_richards 2y agoI often find the opposite. Documentation can be up to date, but AI suggests deprecated or removed functions because there’s more old code than new code. Pgx v5 is a particularly consistent example.
- Capricorn2481 2y agoForum posts can also be out of date.
- randomNumber7 2y agoI think that too but google claims something else.
- delfinom 2y agoI've never had an AI not just make up API when it didn't exist, instead of saying "it doesn't exist". Lol