3 ms·
>F# Barely exists in training data. Might as well ask it to code some microcontroller specifically assembly, watch it fail and claim victory.
by dontupvoteme 3y ago
>F#
Barely exists in training data.
Might as well ask it to code some microcontroller specifically assembly, watch it fail and claim victory.
- ryanjshaw 3y ago> Barely exists in training data. Irrelevant - this is basic computer science. As far as I know, you can't create a bidirectional graph node structure without a mutable data structure or language magic that ultimately hides the same mutability. The fact that ChatGPT recognizes the mutability issue when I explain the bug tells you it has the knowledge, but it doesn't correctly infer the right answer and instead makes false claims and sends developers down the wrong path. This speaks to OP's claim about subtle inaccuracies. I have used ChatGPT to write 10k lines of a static analyzer for a 1k AST model definition in F#, without knowing the language before I started. I'm a big fan, but there were many, many times a less experienced developer would have shot themselves in the foot using it blindly on a project with any degree of complexity.
- dontupvoteme 3y agoI would agree with you if it was a model trained to do computer science, rather than a model to basically do anything, which just happens to be able to do computer science as well. Also code is probably one of the easiest use cases for detecting hallucinations since you can literally just see if it is valid or not the majority of the time. It's much harder for cases where your validation involves wikipedia, or academic journals, etc.
- ryanjshaw 3y agoThen we are in agreement but bear in mind that I was replying to this comment: > So, don't leave us in suspense; what do you ask of it? Because I'm quite sure it can already pass it.