It's odd, that on many benchmarks, including mine[0], Nano does better than Mini. 5.4 mini seems to struggle with consistency, and even with temperature 0 some

It's odd, that on many benchmarks, including mine[0], Nano does better than Mini. 5.4 mini seems to struggle with consistency, and even with temperature 0 sometimes gives the correct response, sometimes a wrong one... [0]: https://aibenchy.com/compare/openai-gpt-5-4-medium/openai-gpt-5-4-mini-medium/openai-gpt-5-4-nano-medium/openai-gpt-5-mini-medium/ https://aibenchy.com/compare/openai-gpt-5-4-medium/openai-gp...