4 ms·
With code interpreter, it actually runs the code, so how did failing tests get interpreted as being correct?
by ec109685 3y ago
With code interpreter, it actually runs the code, so how did failing tests get interpreted as being correct?
- skybrian 3y agoI don't know. Why does a language model do anything? The "test" was a print statement, not a unit test. There wasn't a failure message. It had to read the output and compare it to the expected value I gave it. It claimed it got a different result. I guess it didn't really read the result because it strongly expected something else? If you use an assertEquals() that loudly complains, maybe it's less likely to do this? I haven't seen it ignore stack traces.