3 ms·
Nice article! CoPilot by comparison claims that it cannot execute code and then proceeds to compute a square root in the next question. CoPilot has many simil
by lasyct 2y ago
Nice article! CoPilot by comparison claims that it cannot execute code and then proceeds to compute a square root in the next question.
CoPilot has many similar obvious falsehood issues. Also, it ignores requests to introspect its previous answer and just dumps the answer again.
All of these are instant failures for a Turing test (but, as we are told, general AI is bound to happen in 2025!).
- Tiberium 2y agoAre you sure it actually called to an external tool to compute the square root? Most big LLMs today can do that by themselves.
- lolinder 2y agoCopilot may legitimately be unable to execute code, but when you follow up with a request to compute it responds with a memorized square root. To be 100% sure that it's lying about not being able to compute you would need to have it do something more complicated that it can't possibly have memorized. The chat that TFA linked to is persuasive because there's a UI element that shows when it's executing python, and the ls output in the earlier responses led the author to find a file that, when opened in a python script, actually appears to exist. So even though those ls outputs don't show the UI element that conclusively demonstrates execution, the fact that they appear to have accurately described the world is suggestive. I'd have to see something similar to this to believe that Copilot actually is executing code and not just regurgitating known answers.