3 ms·

However, it shows that the AI is not self-aware enough to realize by itself that it needs to write a program to get the correct answer.

• zamadatix 2y ago
  If Calc 2 students don't respond to integration questions with Mathematica syntax is the conclusion they aren't self aware or they are aware how they are tested? I.e. what you're measuring is what the training environment considered a valid response, not what "self awareness" the AI has to produce the answer you individually expect it to. The model doesn't include a Python interpreter to resolve the answer with so answers which output a Python script then just sat back early were severely penalized vs actual attempts. Explicit requests for a Python script instead of an answer excluded as a Python script is a valid answer to that question. The following is a complete assumption... but I wonder if "separately trained model + added tooling explicitly called in the prompt" results in stronger reasoning strength compared to "model trained with the assumption it can use external tooling as part of its answers all the time". I.e. if you're not pushing a model to encode more of the mechanics behind things does it "reason" as well about what to do with them vs adding the tooling on top of the model at the end.