4 ms·

I plan to hack it to use openrouter and Kimi K3 or GLM 5.2 to keep expenses reasonable. For context can you share the line count?

ymir_e 2mo ago
FYI: Kimi K3 is relatively expensive on open router API pricing for agentic tasks, or at least that's been my experience playing around with it.
- teaearlgraycold 2mo ago
  They just opened the weights. I expect competition from various providers will drop the price a bit. But you're right. I'd hope a model closer to GLM 5.2's price would be sufficiently useful.
  - dannyw 2mo ago
    A license and presumably revshare is required for large scale inference as a service of Kimi K3. There's clearly something going on right now with every router at the same or higher price as the Moonshot list price. So I wouldn't count on competition if $/mil token is actually set by Moonshot, but I would expect $/tok to drop when there's a more competitive frontier open weight model.
    - Tepix 2mo ago
      Where did you get that from? That‘s not what the license says: https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE The current price is likely a result of the high demand and the high requirements of this model.
      - catgirlinspace 2mo ago
        if you’re hosting it then you have to have an agreement with Moonshot, which presumably includes terms about pricing.
        purerandomness 2mo ago
        Only if "the aggregate revenue of the Licensee and its affiliates exceeds 20 million US dollars (or the equivalent in other currencies) in total over any consecutive 12 months"
      - klausa 2mo ago
        Did you actually read the license? > If the Licensee or any of its affiliates operates a Model as a Service business, and the aggregate revenue of the Licensee and its affiliates exceeds 20 million US dollars (or the equivalent in other currencies) in total over any consecutive 12 months, the Licensee must enter into a separate agreement with Moonshot AI before using the Software or its derivative works for any commercial purpose.
        Tepix 2mo ago
        I stand corrected. I read over that multiple times somehow. Looks as if these companies could wait until they reach $20 million of revenue with Kimi K3 until they enter a separate agreement.
st3fan 2mo ago
Give this a try https://infosec.exchange/@st3fan/117000352530023032 https://infosec.exchange/@st3fan/117000352530023032
typpo 2mo ago
No need to hack it, we'll add proper support for this.
- teaearlgraycold 2mo ago
  Excellent. Stuff like this, or LLM SRE automation, are big product spaces for the future.

ymir_e 2mo ago

FYI: Kimi K3 is relatively expensive on open router API pricing for agentic tasks, or at least that's been my experience playing around with it.

teaearlgraycold 2mo ago
They just opened the weights. I expect competition from various providers will drop the price a bit. But you're right. I'd hope a model closer to GLM 5.2's price would be sufficiently useful.
- dannyw 2mo ago
  A license and presumably revshare is required for large scale inference as a service of Kimi K3. There's clearly something going on right now with every router at the same or higher price as the Moonshot list price. So I wouldn't count on competition if $/mil token is actually set by Moonshot, but I would expect $/tok to drop when there's a more competitive frontier open weight model.
  - Tepix 2mo ago
    Where did you get that from? That‘s not what the license says: https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE https://huggingface.co/moonshotai/Kimi-K3/blob/main/LICENSE The current price is likely a result of the high demand and the high requirements of this model.
    - catgirlinspace 2mo ago
      if you’re hosting it then you have to have an agreement with Moonshot, which presumably includes terms about pricing.
      - purerandomness 2mo ago
        Only if "the aggregate revenue of the Licensee and its affiliates exceeds 20 million US dollars (or the equivalent in other currencies) in total over any consecutive 12 months"
    - klausa 2mo ago
      Did you actually read the license? > If the Licensee or any of its affiliates operates a Model as a Service business, and the aggregate revenue of the Licensee and its affiliates exceeds 20 million US dollars (or the equivalent in other currencies) in total over any consecutive 12 months, the Licensee must enter into a separate agreement with Moonshot AI before using the Software or its derivative works for any commercial purpose.
      - Tepix 2mo ago
        I stand corrected. I read over that multiple times somehow. Looks as if these companies could wait until they reach $20 million of revenue with Kimi K3 until they enter a separate agreement.

st3fan 2mo ago

Give this a try https://infosec.exchange/@st3fan/117000352530023032 https://infosec.exchange/@st3fan/117000352530023032

typpo 2mo ago

No need to hack it, we'll add proper support for this.

teaearlgraycold 2mo ago
Excellent. Stuff like this, or LLM SRE automation, are big product spaces for the future.