3 ms·

> an API that is likely a loss-leader to grab market share (hosted LLM cloud models) Everyone just repeats this but I never buy it. There is literally a servi

> an API that is likely a loss-leader to grab market share (hosted LLM cloud models) Everyone just repeats this but I never buy it. There is literally a service that allows you to switch models and service providers seamlessly (openrouter). There is just no lock-in. It doesn't make any financial sense to "grab market share". If you sell something with UI, like ChatGPT (the web interface) or Cursor, sure. But selling API at a loss is peak stupidity and even VCs can see that.

julianeon 1y ago
This is also the argument of the guy in the article, fyi (it's not a loss leader, no reason for it to be).
mupuff1234 1y ago
Except they most likely do have a plan to make it harder to switch.
- raincole 1y ago
  Yeah, sure, please elaborate on how providers such as Fireworks, DeepInfra, Chutes are going to "make it harder to switch."
  - mupuff1234 1y ago
    I'm talking about openAI, anthropic, Google, etc. They'll offer consumer and enterprise integrations that will only work with their models.
    - hedayet 1y ago
      yes. And they will try both carrots and sticks. The carrots are already visible - think abstractions like "projects" in ChatGPT.
- DarmokJalad1701 1y ago
  Who is "they"? It makes no sense for Openrouter to allow providers that do not conform to the API. They profit from the commission from the fees and not providing inference.
zdp7 1y ago
You can't switch to a competitor that went out of business. If you low ball your rates, it starves startups of needed funds
raxxorraxor 1y ago
Depends on the business case. LLM slowly creep into several workflows and here determinism becomes more important than the latest abilities in reasoning. People start to let their LLM parse text content. Be that mails, chats or transcriptions, the models often need to formalize their output and switching models can become burdensome, while developers might switch models on a whim. Doesn't mean you can capture a market by selling cheap though.

julianeon 1y ago

This is also the argument of the guy in the article, fyi (it's not a loss leader, no reason for it to be).

mupuff1234 1y ago

Except they most likely do have a plan to make it harder to switch.

raincole 1y ago
Yeah, sure, please elaborate on how providers such as Fireworks, DeepInfra, Chutes are going to "make it harder to switch."
- mupuff1234 1y ago
  I'm talking about openAI, anthropic, Google, etc. They'll offer consumer and enterprise integrations that will only work with their models.
  - hedayet 1y ago
    yes. And they will try both carrots and sticks. The carrots are already visible - think abstractions like "projects" in ChatGPT.
DarmokJalad1701 1y ago
Who is "they"? It makes no sense for Openrouter to allow providers that do not conform to the API. They profit from the commission from the fees and not providing inference.

zdp7 1y ago

You can't switch to a competitor that went out of business. If you low ball your rates, it starves startups of needed funds

raxxorraxor 1y ago

Depends on the business case. LLM slowly creep into several workflows and here determinism becomes more important than the latest abilities in reasoning. People start to let their LLM parse text content. Be that mails, chats or transcriptions, the models often need to formalize their output and switching models can become burdensome, while developers might switch models on a whim. Doesn't mean you can capture a market by selling cheap though.