5 ms·

Is this actually true? I want to see actual evals that match this up with Sonnet 4.5.

by aliljet 7mo ago

lostmsu 7mo ago
Not exactly, but pretty close: https://artificialanalysis.ai/models/capabilities/coding?models=gpt-oss-120b%2Cgpt-5-2%2Cgpt-5-2-codex%2Cgpt-5-3-codex%2Cgemini-3-flash-reasoning%2Cgemini-3-1-pro-preview%2Cclaude-sonnet-4-6-adaptive%2Cclaude-4-5-haiku-reasoning%2Cclaude-opus-4-6-adaptive%2Cdeepseek-v3-2-reasoning%2Cminimax-m2-5%2Ckimi-k2-5%2Cglm-5%2Cqwen3-5-122b-a10b%2Cqwen3-5-397b-a17b%2Cqwen3-5-35b-a3b%2Cclaude-4-5-sonnet-thinking https://artificialanalysis.ai/models/capabilities/coding?mod... Somewhere between Haiku 4.5 and Sonnet 4.5
- CharlesW 7mo ago
  > Somewhere between Haiku 4.5 and Sonnet 4.5 That's like saying "somewhere between Eliza and Haiku 4.5". Haiku is not even a so-called 'reasoning model'.¹ ¹ To preempt the easily-offended, this is what the latest Opus 4.6 in today's Claude Code update says: "Claude Haiku 4.5 is not a reasoning model — it's optimized for speed and cost efficiency. It's the fastest model in the Claude family, good for quick, straightforward tasks, but it doesn't have extended thinking/reasoning capabilities."
  - pityJuke 7mo ago
    Haiku 4.5 is a reasoning model. [0] [0]: https://www-cdn.anthropic.com/7aad69bf12627d42234e01ee7c36305dc2f6a970.pdf https://www-cdn.anthropic.com/7aad69bf12627d42234e01ee7c3630... > Claude Haiku 4.5, a new hybrid reasoning large language model from Anthropic in our small, fast model class. > As with each model released by Anthropic beginning with Claude Sonnet 3.7, Claude Haiku 4.5 is a hybrid reasoning model. This means that by default the model will answer a query rapidly, but users have the option to toggle on “extended thinking mode”, where the model will spend more time considering its response before it answers. Note that our previous model in the Haiku small-model class, Claude Haiku 3.5, did not have an extended thinking mode.
    - CharlesW 7mo ago
      Sure, marketing people gonna market. But Haiku's 'extended thinking' mode is very different than the reasoning capabilities of Sonnet or Opus. I would absolutely believe mar-ticles that Qwen has achieved Haiku 4.5 'extended thinking' levels of coding prowess.
      - DetroitThrow 7mo ago
        >Sure, marketing people gonna market. Oh HN never change.
        deleted 7mo ago
        [deleted]
        CharlesW 7mo ago
        Not sure what this means, but as a marketing person myself, here's what happened: One day, an Anthropican involved in the Haiku 4.5 launch shrugged, weighed the odds of getting spanked for equating "extended thinking" with "reasoning", and then used Claude to generate copy declaring that. It's not rocket surgery!
        DetroitThrow 7mo ago
        It's mainly that people on here, regardless of profession, speak incorrectly but confidentally about things that could be easily verified with a Google search or basic familiarity with the thing in question. Haiku 4.5 is a reasoning model, regardless of whatever hallucination you read. Being a hybrid reasoning model means that, depending on the complexity of the question and whether you explicitly enable reasoning (this is "extended thinking" in the API and other interfaces) when making a request to the LLM, it will emit reasoning tokens separately prior to the tokens used in the main response. I love your theory that there was some mix up on their side because they were lazy and it was just some marketing dude being quirky with the technical language.
        7mo ago
- pinum 7mo ago
  Looks much closer to Haiku than Sonnet. Maybe "Qwen3.5 122B offers Haiku 4.5 performance on local computers" would be a more realistic and defensible claim.
  - lostmsu 7mo ago
    I won't disagree - the guideline prescribes to keep the original title as much as possible, and I failed to find more neutral source.
magicalhippo 7mo ago
The Qwen3.5 27B model did almost the same as Sonnet 4.5 in this[1] reasoning benchmark, results here[2]. Obviously there's more to a model than that but it's a data point. [1]: https://github.com/fairydreaming/lineage-bench https://github.com/fairydreaming/lineage-bench [2]: https://github.com/fairydreaming/lineage-bench-results/tree/main/lineage-8_64_128_192#results https://github.com/fairydreaming/lineage-bench-results/tree/...

Is this actually true? I want to see actual evals that match this up with Sonnet 4.5.

by aliljet 7mo ago

Is this actually true? I want to see actual evals that match this up with Sonnet 4.5.

Not exactly, but pretty close: https://artificialanalysis.ai/models/capabilities/coding?models=gpt-oss-120b%2Cgpt-5-2%2Cgpt-5-2-codex%2Cgpt-5-3-codex%2Cgemini-3-flash-reasoning%2Cgemini-3-1-pro-preview%2Cclaude-sonnet-4-6-adaptive%2Cclaude-4-5-haiku-reasoning%2Cclaude-opus-4-6-adaptive%2Cdeepseek-v3-2-reasoning%2Cminimax-m2-5%2Ckimi-k2-5%2Cglm-5%2Cqwen3-5-122b-a10b%2Cqwen3-5-397b-a17b%2Cqwen3-5-35b-a3b%2Cclaude-4-5-sonnet-thinking https://artificialanalysis.ai/models/capabilities/coding?mod... Somewhere between Haiku 4.5 and Sonnet 4.5

CharlesW 7mo ago
> Somewhere between Haiku 4.5 and Sonnet 4.5 That's like saying "somewhere between Eliza and Haiku 4.5". Haiku is not even a so-called 'reasoning model'.¹ ¹ To preempt the easily-offended, this is what the latest Opus 4.6 in today's Claude Code update says: "Claude Haiku 4.5 is not a reasoning model — it's optimized for speed and cost efficiency. It's the fastest model in the Claude family, good for quick, straightforward tasks, but it doesn't have extended thinking/reasoning capabilities."
- pityJuke 7mo ago
  Haiku 4.5 is a reasoning model. [0] [0]: https://www-cdn.anthropic.com/7aad69bf12627d42234e01ee7c36305dc2f6a970.pdf https://www-cdn.anthropic.com/7aad69bf12627d42234e01ee7c3630... > Claude Haiku 4.5, a new hybrid reasoning large language model from Anthropic in our small, fast model class. > As with each model released by Anthropic beginning with Claude Sonnet 3.7, Claude Haiku 4.5 is a hybrid reasoning model. This means that by default the model will answer a query rapidly, but users have the option to toggle on “extended thinking mode”, where the model will spend more time considering its response before it answers. Note that our previous model in the Haiku small-model class, Claude Haiku 3.5, did not have an extended thinking mode.
  - CharlesW 7mo ago
    Sure, marketing people gonna market. But Haiku's 'extended thinking' mode is very different than the reasoning capabilities of Sonnet or Opus. I would absolutely believe mar-ticles that Qwen has achieved Haiku 4.5 'extended thinking' levels of coding prowess.
    - DetroitThrow 7mo ago
      >Sure, marketing people gonna market. Oh HN never change.
      - deleted 7mo ago
        [deleted]
      - CharlesW 7mo ago
        Not sure what this means, but as a marketing person myself, here's what happened: One day, an Anthropican involved in the Haiku 4.5 launch shrugged, weighed the odds of getting spanked for equating "extended thinking" with "reasoning", and then used Claude to generate copy declaring that. It's not rocket surgery!
        DetroitThrow 7mo ago
        It's mainly that people on here, regardless of profession, speak incorrectly but confidentally about things that could be easily verified with a Google search or basic familiarity with the thing in question. Haiku 4.5 is a reasoning model, regardless of whatever hallucination you read. Being a hybrid reasoning model means that, depending on the complexity of the question and whether you explicitly enable reasoning (this is "extended thinking" in the API and other interfaces) when making a request to the LLM, it will emit reasoning tokens separately prior to the tokens used in the main response. I love your theory that there was some mix up on their side because they were lazy and it was just some marketing dude being quirky with the technical language.
        7mo ago
pinum 7mo ago
Looks much closer to Haiku than Sonnet. Maybe "Qwen3.5 122B offers Haiku 4.5 performance on local computers" would be a more realistic and defensible claim.
- lostmsu 7mo ago
  I won't disagree - the guideline prescribes to keep the original title as much as possible, and I failed to find more neutral source.

magicalhippo 7mo ago

The Qwen3.5 27B model did almost the same as Sonnet 4.5 in this[1] reasoning benchmark, results here[2]. Obviously there's more to a model than that but it's a data point. [1]: https://github.com/fairydreaming/lineage-bench https://github.com/fairydreaming/lineage-bench [2]: https://github.com/fairydreaming/lineage-bench-results/tree/main/lineage-8_64_128_192#results https://github.com/fairydreaming/lineage-bench-results/tree/...