3 ms·
The fact that it's hard to say is funny, in contrast with the fanfare surrounding the launch of Fable.
by Retr0id 4mo ago
The fact that it's hard to say is funny, in contrast with the fanfare surrounding the launch of Fable.
- greenavocado 4mo agoFable is currently way below many other models in the rankings due to some sort of internal throttling https://aistupidlevel.info/ https://aistupidlevel.info/ GPT-5.4 is currently the strongest model (this changes hourly) Methodology: https://aistupidlevel.info/faq#methodology https://aistupidlevel.info/faq#methodology
- DetroitThrow 4mo agoMethodology leaves a lot to be desired in terms of understanding the tasks you've used. Being detailed about why they're more meaningful tests than the long horizon and coding tests used by other rankings is important. False positives and poorly defined tasks/acceptance criteria have let some models have insanely inflated scores on bad benchmarks. And sure, you can say they're not disclosed to prevent gaming, but if you're the only one who can review them then the might as well be a random number generator display with an unreadable UI.
- greenavocado 4mo agoYou're not wrong, but the scores track with my experience switching between the proposed top variants. So there's my unscientific "evidence."
- Retr0id 4mo agoWell, that's certainly some web design.