3 ms·

"Prompts and completions are retained by the provider and are not used for training..." I'm curious what the model provider is using the prompt/response pairs

"Prompts and completions are retained by the provider and are not used for training..." I'm curious what the model provider is using the prompt/response pairs for, in that case. They aren't offering a model for free without their name on it for no reason.

redrix 2mo ago
Research, analytics, usage trends, etc. All still incredibly valuable for a company building and tuning an LLM; even if the data itself isn’t directly used in the training set.
- jrumbut 2mo ago
  I am genuinely confused. Are they telling me this because they expect me to be reassured that this anonymous organization is not using my prompts or are they saying "don't expect this particular model to improve as you use it?"
  - maccam912 2mo ago
    No, I think it's a warning like "don't feed it secrets". Like you get a model to use for free but in return you give up any illusion of your data being private.
Fnoord 2mo ago
Stealth Model, is this a CTF? LLM needs to become more transparent, not less. Hence, this idea (and trend, possibly) is disgusting. How can we even possibly verify 'Prompts and completions are retained by the provider and are not used for training...'? What if the training is done, but used internally?
- dghlsakjg 2mo ago
  This isn’t new. Openrouter has had stealth models for a while. They have had free models for a while. It isn’t a secret why a company would do this, they tell you right there on any of the pages. Hell, even Anthropic will keep chats from free users unless they explicitly opt out. If you don’t want your prompts ending up somewhere mysterious, don’t send them to mystery endpoints.
torginus 2mo ago
I think this means its used for training, but there is some elaborate legal argument that allows them to claim its really not. Like they dont pretrain on your chats but they do some transforms/RLHF/sentiment analysis. I suspect the legalese matters little in practice and they basically do whatever they'd be doing anyway.
8note 2mo ago
its not like you could sue them if they did train its pretty clearly nit a contract with open router, and you have no agreement with the lab to not train

redrix 2mo ago

Research, analytics, usage trends, etc. All still incredibly valuable for a company building and tuning an LLM; even if the data itself isn’t directly used in the training set.

jrumbut 2mo ago
I am genuinely confused. Are they telling me this because they expect me to be reassured that this anonymous organization is not using my prompts or are they saying "don't expect this particular model to improve as you use it?"
- maccam912 2mo ago
  No, I think it's a warning like "don't feed it secrets". Like you get a model to use for free but in return you give up any illusion of your data being private.

Fnoord 2mo ago

Stealth Model, is this a CTF? LLM needs to become more transparent, not less. Hence, this idea (and trend, possibly) is disgusting. How can we even possibly verify 'Prompts and completions are retained by the provider and are not used for training...'? What if the training is done, but used internally?

dghlsakjg 2mo ago
This isn’t new. Openrouter has had stealth models for a while. They have had free models for a while. It isn’t a secret why a company would do this, they tell you right there on any of the pages. Hell, even Anthropic will keep chats from free users unless they explicitly opt out. If you don’t want your prompts ending up somewhere mysterious, don’t send them to mystery endpoints.

torginus 2mo ago

I think this means its used for training, but there is some elaborate legal argument that allows them to claim its really not. Like they dont pretrain on your chats but they do some transforms/RLHF/sentiment analysis. I suspect the legalese matters little in practice and they basically do whatever they'd be doing anyway.

8note 2mo ago

its not like you could sue them if they did train its pretty clearly nit a contract with open router, and you have no agreement with the lab to not train