3 ms·

All of these models are currently charging well below what they really cost to run, mostly propped up by VC money. I don’t expect the price of using these AI mo

All of these models are currently charging well below what they really cost to run, mostly propped up by VC money. I don’t expect the price of using these AI models to come down —— in fact they’ll probably rise sharply in the next year as investor money dries up and these companies desperately search for a path to profitability.

xoac 2y ago
As always the plan is to destroy existing industries and then raise prices to above the actual cost.
- Loughla 2y ago
  What existing industries are LLM's destroying?
  - grugagag 2y ago
    Translators, subtitle workers, illustrators, plus whatever industries are entrenching themselves in genAI as we speak. When prices go up the reality will kick in, some would fold, others will need to be cleaned up
    - mistrial9 2y ago
      anything with tech support; anything with reviewing common forms for bureaucratic purposes; anything with writing skills for daily mundane events. Note that the interest in LLMs is positively massive in India, China, and other population centers.
  - mhuffman 2y ago
    Customer support centers.
    - throwaway14356 2y ago
      its crazy how big tech corps still cant be bothered to put up a support bot. I found a bunch of people who got banned from facebook market place without a reason they could figure out. There is suppose to be a message with a link to have your account reviewed but they didn't get any. The funniest one was someone looking at ads regularly but never placed an add, didn't purchase and didn't interact. Someone else got banned every day for two months, always at the same time, they requested a review and got access again until the message with the link didn't arrive. Now they can only request a review for an item that violates policy to be picked out of an empty list. The idea was obviously to have a well defined step by step process but if bugs prevent that a fuzzy approach with al llm could alert them to this. If I can find 50ish cases they must have tens of thousands at least. You would kinda want to know stuff like that.
infecto 2y ago
Do you have facts to back up this claim?
jgalt212 2y ago
It's hard to say on this one. When Google first bought YouTube they were getting killed on video streaming costs, but then that became much much cheaper. So much so that in any FTC mandated Alphabet break up, I might prefer the video biz over the search biz. Especially if Tik Tok is banned.
whiplash451 2y ago
Distillation will make the inference cost of these models go down by a lot.
deleted 2y ago
[deleted]

xoac 2y ago

As always the plan is to destroy existing industries and then raise prices to above the actual cost.

Loughla 2y ago
What existing industries are LLM's destroying?
- grugagag 2y ago
  Translators, subtitle workers, illustrators, plus whatever industries are entrenching themselves in genAI as we speak. When prices go up the reality will kick in, some would fold, others will need to be cleaned up
  - mistrial9 2y ago
    anything with tech support; anything with reviewing common forms for bureaucratic purposes; anything with writing skills for daily mundane events. Note that the interest in LLMs is positively massive in India, China, and other population centers.
- mhuffman 2y ago
  Customer support centers.
  - throwaway14356 2y ago
    its crazy how big tech corps still cant be bothered to put up a support bot. I found a bunch of people who got banned from facebook market place without a reason they could figure out. There is suppose to be a message with a link to have your account reviewed but they didn't get any. The funniest one was someone looking at ads regularly but never placed an add, didn't purchase and didn't interact. Someone else got banned every day for two months, always at the same time, they requested a review and got access again until the message with the link didn't arrive. Now they can only request a review for an item that violates policy to be picked out of an empty list. The idea was obviously to have a well defined step by step process but if bugs prevent that a fuzzy approach with al llm could alert them to this. If I can find 50ish cases they must have tens of thousands at least. You would kinda want to know stuff like that.

infecto 2y ago

Do you have facts to back up this claim?

jgalt212 2y ago

It's hard to say on this one. When Google first bought YouTube they were getting killed on video streaming costs, but then that became much much cheaper. So much so that in any FTC mandated Alphabet break up, I might prefer the video biz over the search biz. Especially if Tik Tok is banned.

whiplash451 2y ago

Distillation will make the inference cost of these models go down by a lot.

deleted 2y ago

[deleted]