3 ms·
Agreed. That does seem to be an example of a language model failing to understand the context in which the question was asked. The user was implicitly expectin
by alpos 4y ago
Agreed. That does seem to be an example of a language model failing to understand the context in which the question was asked.
The user was implicitly expecting code that would function when executed immediately and as written with no additional supporting libraries included. This is different from code that would function correctly when executed after having downloaded relevant existing packages. Which is different from code that would function if executed along side additional supporting code from private libraries the user might not have access to. Etc...
Yet any of those answers fit for the same prompt, "create an R script that does such and such". The bot's lack of insight is on the likely intention behind the prompt rather than on the requested language. I'd say if it produces any code that fits the syntax and grammatical structure of the requested language, that's enough to say it understands the language.