2 ms·
The first Twitter link shows much worse performance of 4-O on coding/reasoning when compared to 4. I am not convinced that 4-O is better than 4-T. In my own te
by OutOfHere 3y ago
The first Twitter link shows much worse performance of 4-O on coding/reasoning when compared to 4.
I am not convinced that 4-O is better than 4-T. In my own testing of getting it to write about future events as if they've already occurred, 4-O was hallucinating across the board whereas 4-T wasn't, making their score 0 and 100 respectively.
As I have see over a long period, OpenAI has had a systemic and longstanding problem of optimizing some goals at the expense of many others. It's always the same story with them: they advertise some updates without telling you all the ways in which the model is now worse.