4 ms·
> That's quite common with many models Such as? I can't think of any. Diminishing returns, yes. Occasionally flat, yes. Downright regression, no.
by GodelNumbering 1mo ago
> That's quite common with many models
Such as?
I can't think of any. Diminishing returns, yes. Occasionally flat, yes. Downright regression, no.
- XCSme 1mo agoIn my own tests on aibenchy.com, where questions are quite simple, higher reasoning efforts consistently used to do worse than medium for most models. The reasoning effort should match the complexity of the task against the model's capability. Hard task with low reasoning = bad Easy task with very high reasoning = bad
- minatoaqua1 1mo agogrok 4.6
- JacobAsmuth 1mo agoLOL
- desterothx 1mo agoiirc, some of the original fable bemchmarks showed this. Definitely saw it in other frontier releases though