3 ms·
You want a refund because of a problem you weren't even aware of until now? And you don't even really know if your work has been impacted by this problem.
by cbg0 3mo ago
You want a refund because of a problem you weren't even aware of until now? And you don't even really know if your work has been impacted by this problem.
- linzhangrun 3mo agoNo, the decline in GPT-5.5's performance over the past few weeks is clearly noticeable.
- cbg0 3mo agoDoesn't look like it: https://marginlab.ai/trackers/codex/ https://marginlab.ai/trackers/codex/
- mdgld 3mo agoCool resource and perfect way to track this, thanks for sharing
- linzhangrun 3mo agoThanks for sharing this project. Maybe I'm being subjective.
- memoriyato3 3mo agoits called hedonic adaptation - you get excited by a new model, but then the excitement disappears, and you confuse that with the model being nerfed
- rahidz 3mo agoSo what are we to make of the two items: - This tracker not showing any visible degradation. - Clearly incorrect answers being reported due to truncated thinking. Is the tracker not measuring 'simpler' tasks that might get auto-sent to "low reasoning hell" even on high/xhigh? Is the clustering not actually causing reasoning misses in real-life coding, or not enough of a negative effect compared to the improvements made elsewhere? Something else?