4 ms·

> We switched to the "triager" pattern: a Haiku agent with a very specific and narrow job. Is this issue already tracked or not? If it is, stop right there. If

by wxw 6mo ago

> We switched to the "triager" pattern: a Haiku agent with a very specific and narrow job. Is this issue already tracked or not? If it is, stop right there. If not, escalate to Opus. > 4 out of 5 failures never reach Opus. A triager match costs around 25x less than a full investigation. The title feels misleading. Why clickbait on that when you can just be genuine about the architecture?

idorosen 6mo ago
The title does not match the article title: “We Upgraded to a Frontier Model and Our Costs Went Down”.
- stingraycharles 6mo ago
  It’s still misleading, though.
shad42 6mo ago
I am one of Mendral co-founder (my co-founder wrote the article), I am the one to blame for changing the title when posting. I thought our original one was too clickbait and I wanted to better summarize with this title. Despite the original title, a lot of what we learned comes to how Opus evolved and the ability to reason. And also the fact that Haiku is quite capable if scoped properly, that's the whole purpose of the article.
- locknitpicker 6mo ago
  > Despite the original title, a lot of what we learned comes to how Opus evolved and the ability to reason. And also the fact that Haiku is quite capable if scoped properly, that's the whole purpose of the article. I think you're misrepresenting the whole thing. The blog post boils down to introducing a specialized triage step which is then offloaded to a cheap model. The cost savings come from skipping the expensive model. It has absolutely nothing to do with what choice of expensive model is being used. You could write the same blog post by completely ignoring and omitting the expensive model.
  - kovek 6mo ago
    Does thinking about how to offload matter?
    - locknitpicker 6mo ago
      A discussion on how to avoid paying the price of running an expensive model is not about the expensive model. You can triage things running a cheap model with Ollama. Heck, throw in gpt4.1 which is free.
      - kovek 6mo ago
        I don’t think triaging is necessarily an easy task

by wxw 6mo ago

idorosen 6mo ago

The title does not match the article title: “We Upgraded to a Frontier Model and Our Costs Went Down”.

stingraycharles 6mo ago
It’s still misleading, though.

shad42 6mo ago

I am one of Mendral co-founder (my co-founder wrote the article), I am the one to blame for changing the title when posting. I thought our original one was too clickbait and I wanted to better summarize with this title. Despite the original title, a lot of what we learned comes to how Opus evolved and the ability to reason. And also the fact that Haiku is quite capable if scoped properly, that's the whole purpose of the article.

locknitpicker 6mo ago
> Despite the original title, a lot of what we learned comes to how Opus evolved and the ability to reason. And also the fact that Haiku is quite capable if scoped properly, that's the whole purpose of the article. I think you're misrepresenting the whole thing. The blog post boils down to introducing a specialized triage step which is then offloaded to a cheap model. The cost savings come from skipping the expensive model. It has absolutely nothing to do with what choice of expensive model is being used. You could write the same blog post by completely ignoring and omitting the expensive model.
- kovek 6mo ago
  Does thinking about how to offload matter?
  - locknitpicker 6mo ago
    A discussion on how to avoid paying the price of running an expensive model is not about the expensive model. You can triage things running a cheap model with Ollama. Heck, throw in gpt4.1 which is free.
    - kovek 6mo ago
      I don’t think triaging is necessarily an easy task