3 ms·

Devil's advocate, it could be that it did the math correctly, then inserted the error because humans do that sometimes in the text it was trained on. That would

Devil's advocate, it could be that it did the math correctly, then inserted the error because humans do that sometimes in the text it was trained on. That wouldn't be "failing" anything.

Jensson 5y ago
In that case it wouldn't get worse results than the data it trained on.
- anonymfus 5y ago
  It can get worse results for example if the prompt is biased towards the worse part of the data.