Copilot may legitimately be unable to execute code, but when you follow up with a request to compute it responds with a memorized square root. To be 100% sure t

Copilot may legitimately be unable to execute code, but when you follow up with a request to compute it responds with a memorized square root. To be 100% sure that it's lying about not being able to compute you would need to have it do something more complicated that it can't possibly have memorized. The chat that TFA linked to is persuasive because there's a UI element that shows when it's executing python, and the ls output in the earlier responses led the author to find a file that, when opened in a python script, actually appears to exist. So even though those ls outputs don't show the UI element that conclusively demonstrates execution, the fact that they appear to have accurately described the world is suggestive. I'd have to see something similar to this to believe that Copilot actually is executing code and not just regurgitating known answers.