4 ms·

I wonder who will be the first to bite the bullet and try charging different rates for LLM inference depending on whether it's for commercial purposes. Enforcem

I wonder who will be the first to bite the bullet and try charging different rates for LLM inference depending on whether it's for commercial purposes. Enforcement would be a nightmare but they'd probably try to throw AI at that as well, successfully or not.

chis 1y ago
I think there are always creative ways to differentiate the two tiers for those who care. “Free tier users relinquish all rights to their (anonymized) queries, which may be used for training purposes. Enterprise tier, for $200/mo, guarantees queries can only be seen by the user”
- emzo 1y ago
  This would be great for open source projects
- jfrbfbreudh 1y ago
  This is what Google currently does for access to their top models. AI Studio (web UI, free, will train on your data) vs API (won’t train on your data).
  - koakuma-chan 1y ago
    Can't train on my data if all my data is produced by them.
  - BoredPositron 1y ago
    If you use the API for free the data is used for training.
- ethbr1 1y ago
  The bigger commercial / enterprise differentiator will probably be around audit and guardrails. Unnecessary for individual use; required for scaled corporate use.
  - AbstractH24 1y ago
    The SSO premium of the AI era
    - ethbr1 1y ago
      Features are better price segmenters than utilization.
- otabdeveloper4 1y ago
  > guarantees queries can only be seen by the user The only way to "guarantee" that is to run your models locally on your own hardware. I'm guessing we'll see a renaissance of the "desktop" and "workstation" cycle once this AI bubble pops. ("Cloud" will be the big loser.)
chw9e 1y ago
probably the idea behind the coding tools eventually. cursor charges a 20% margin on every token for their max models but people still use them
beefnugs 1y ago
I think the real problem is that is even an option. I am not a good businessman, but i have seen good ideas fail because the company depends upon the good graces of another company. If someone can decide to just fuck you over for any reason, it will happen sooner or later Sending all your core IP through another company for them to judge your worthiness of existence, is a nightmare on so many levels , the biggest example being payment processors trying to impose their religious doctrine on entire populations

chis 1y ago

I think there are always creative ways to differentiate the two tiers for those who care. “Free tier users relinquish all rights to their (anonymized) queries, which may be used for training purposes. Enterprise tier, for $200/mo, guarantees queries can only be seen by the user”

emzo 1y ago
This would be great for open source projects
jfrbfbreudh 1y ago
This is what Google currently does for access to their top models. AI Studio (web UI, free, will train on your data) vs API (won’t train on your data).
- koakuma-chan 1y ago
  Can't train on my data if all my data is produced by them.
- BoredPositron 1y ago
  If you use the API for free the data is used for training.
ethbr1 1y ago
The bigger commercial / enterprise differentiator will probably be around audit and guardrails. Unnecessary for individual use; required for scaled corporate use.
- AbstractH24 1y ago
  The SSO premium of the AI era
  - ethbr1 1y ago
    Features are better price segmenters than utilization.
otabdeveloper4 1y ago
> guarantees queries can only be seen by the user The only way to "guarantee" that is to run your models locally on your own hardware. I'm guessing we'll see a renaissance of the "desktop" and "workstation" cycle once this AI bubble pops. ("Cloud" will be the big loser.)

chw9e 1y ago

probably the idea behind the coding tools eventually. cursor charges a 20% margin on every token for their max models but people still use them

beefnugs 1y ago

I think the real problem is that is even an option. I am not a good businessman, but i have seen good ideas fail because the company depends upon the good graces of another company. If someone can decide to just fuck you over for any reason, it will happen sooner or later Sending all your core IP through another company for them to judge your worthiness of existence, is a nightmare on so many levels , the biggest example being payment processors trying to impose their religious doctrine on entire populations