7 ms·

Is there anyone who has successfully productized AI? ChatGPT isn’t a profitable product, at least not yet. Google Photos and Spotify recommendations are the bes

by medler 4y ago

Is there anyone who has successfully productized AI? ChatGPT isn’t a profitable product, at least not yet. Google Photos and Spotify recommendations are the best AI products I can think of with clear revenue, and in these examples AI is just a cherry on top of a product people would use anyway.

dougmwne 4y ago
Github Copilot seems like a pretty clear example. They charge a subscription that's in excess of the marginal cost of inference.
- medler 4y ago
  That’s a good point. I forgot about Copilot.
  - visarga 4y ago
    Midjourney, NaturalReaders (text to speech reader)
- andygeorge 4y ago
  curious if/when MS will get desirable returns on the significant investment needed to run/train copilot
  - dougmwne 4y ago
    It's a good question, but also helpful to point out that one of the beauties of these models is that you can train them once and deploy to many use cases. The same model can be used by Github, Bing, Office 365, Azure and so on. And as for the big multi-billion investment in OpenAI, they may have more than made that back up on their valuation already. Plus the deal was structured that OpenAI would pay it's revenues into Microsoft till the investment was paid back and MS would sill end up with a 49% stake. All in all, sounds like a smart investment from MS and, cerry on top, managed to majorly embarrass a main rival.
    - andygeorge 4y ago
      agree on it being a good play by MS. will interesting to see if they do spin it out to their other realms
  - zamnos 4y ago
    The question there is how many of the estimated 100,000 software engineers at Microsoft are using Copilot, and what has been their (I'm sure measured) productivity boost. Microsoft does derive some benefit from Copilot being accessible to the paying subscribers of the world from having them give feedback and in free (and paid) press. But the internal use numbers probably easily justify its initial cost to train. Say Copilot makes an engineer 2x as productive, their all-in salary is $500k to make the math easy, 1,000 MS sw engineers are using it, and Copilot took $5mm to train (GPT-3 took $4.6mm). Those 1k MS employees now being twice as productive are doing the work of an extra 1k people at $500k, or $500 million's worth in a year. That means $5 million in Copilot training costs are paid for in... 4 days. I have no inside information, so those number are all made up, but I'm pretty sure the initial training costs have already been paid off internally. We also don't know how many multiples of $5mm it took to produce the initial version of Copilot, nor how many subsequent training runs there have been. Point is, any significant productivity gains made, across an organization the size of Microsoft engineering, easily pays for big expensive training runs.
    - deleted 4y ago
      [deleted]
    - ssijak 4y ago
      It makes tou nowhere nearly 2x productive. Usefull yes but 2x is a dream
    - visarga 4y ago
      SOME parts of an engineer's work are 2x faster, but not all. Generating code - yes, writing tests and docs - yes, designing the system - no, debugging - no, attending meetings - no, getting your data faster, or moving the other team to finish integration sooner - no help. So it's going to be 10% boost overall, not 100%. The nice effect is that the AI makes people more confident to try things and go out of their comfort zone. Maybe the quality of the end product will be higher.
  - blackoil 4y ago
    If the return are computed by increase in market cap, they may already have got that.
    - deleted 3y ago
      [deleted]
- deanc 4y ago
  I’d be astonished if they’re even close to breaking even on copilot. In its current incarnation it wouldn’t even lace the boots of what’s coming out of OpenAI. CopilotX with its OpenAI collab will be the real winner - if it ever gets released to those on the waitlist. I’m not aware of anyone who got in yet, which leads me to believe it doesn’t yet exist.
  - deleted 4y ago
    [deleted]
  - bugglebeetle 4y ago
    I got access to the Copilot CLI, which is supposed to be part of the Copilot X package eventually. Dunno anyone who has gotten access to Copilot Chat yet, which I expect is what everyone really wants.
  - Aeolun 4y ago
    > In its current incarnation it wouldn’t even lace the boots of what’s coming out of OpenAI. I don’t know about you, but Copilot is part of my daily work, while OpenAI ChatGPT is still more or less a toy to me.
  - fastball 4y ago
    Copilot is already "backed" by OpenAI – it uses Codex under the hood which is a fine-tuned GPT-3 model. CopilotX is not a paradigm shift, it's a version change from GPT-3 to GPT-4.
    - visarga 4y ago
      GPT4 is arguably much better at coding, hence the "paradigm shift".
  - Kiro 4y ago
    Copilot is and has always been OpenAI so not sure what you're talking about.
riffraff 4y ago
if you consider Spotify recommendations as AI then you should consider also Youtube and every social network based on a non-time based timeline and ads, no?
gilbetron 4y ago
I've seen MidJourney's estimated revenue at about $750k/month. Not bad.
- yunwal 4y ago
  This seems likely lower than their costs. Is there a breakdown somewhere?
paxys 4y ago
OpenAI is growing revenues from ~0 in 2022 to $300M in 2023 to $1B in 2024. That sounds like a product to me.
- tensor 4y ago
  "Hopes to grow" revenues. Current estimates put hardware costs alone at $700k/day, so even if they hit $300M in 2023 that won't make them profitable. This isn't even counting the people costs and other operation costs required to run a company. edit: order of magnitude was wrong on costs per day.
  - vasco 4y ago
    Do you have the order of magnitude right at $700/day? That's not much at all.
  - generalizations 4y ago
    And yet, $300M is only 1.25M subscribers at the current $20/mo rate. If we say that they need a $1B / year to be comfortably profitable, that's ~4.2M subscribers. A good rule of thumb is that you can hope to convert about 10% of your free user base to paid; one random source says they have 100M monthly active users - which at 10% conversion, is $2.4B / year. I think they'll be fine.
    - illiarian 4y ago
      How much money will they spend servicing requests for those 4.2M subscribers?
    - ZephyrBlu 4y ago
      10% is insanely high conversion for B2C freemium. It’s closer to 1% for most products.
      - anonylizard 4y ago
        Does GPT-4 look like 'most products'? You are talking about a revolutionary product that literally dominates mindshare from consumers to students to CEOs to governments. Its a pure monopoly that has insanely wide utility and instantly obvious value proposition.
Takennickname 4y ago
GPT API is a successful product. All those start ups that are just a thin layer over GPT that are funded by YCombinator are paying for API use and that's profitable for OpenAI.
- nomel 4y ago
  > and that's profitable for OpenAI. Reference? "Profitable" means they're making more money than they're using, at this moment.
  - Takennickname 4y ago
    Are you implying openai is selling access to their API at a loss?
    - nomel 4y ago
      No, I would like facts, not assumptions. It's definitely not safe to assume they are making a profit, as a whole, or per transaction. It's more complicated than that. Profit has a strict definition of $revenue - $cost, for a business operation as a whole, which leaves money in the bank at the end of the month. They could be making more money for a single query than the cost of compute time for that single query, but that may not cover the engineering and idle servers. They could be running at a loss with the assumption that they can improve efficiency per transaction soon. They could be running at a "loss" because they're giving some of the compute away for free right now, to improve the training with the user responses. Or maybe they are making fistfuls of money. "Profitable" has a strict meaning, shouldn't be assumed, and definitely isn't required, at this point in their operation. I'm very interested to know if they are profitable, at the moment, but I don't think that's been publicly disclosed yet, and I can't find anything. A reference is required.
      - Takennickname 4y ago
        I don't have a reference. I'm taking the very reasonable assumption that openai is making money on API calls based on how much they charge compared to others in this space, the favorable pricing they receive from Microsoft, their ability to constantly bring down the costs and push the savings to their consumers, their unwillingness to lower the cost of Dall-E even though it's more expensive than it's competitors. Very reasonable assumptions. You will never get certainty, even if they say they're profitable maybe they're just lying for investors. If you see their bank account total go up every month maybe it's a ponzi scheme. For my heuristics, if not profitable, at least close, and definitely a major success in acquiring market share and customer mind share.
nr2x 4y ago
I use GPT about 100x more than search now for my day to day work. I pay them $20/mo. I’d likely pay $100 or more for the value I’m getting. They’ll figure it out.
zamnos 4y ago
How do you want to define AI? Google's been using ML models to power various Google products for years. Translate was a big switch over, back in 2016, and it powers the Google Search answer box. I have no idea how profitable that answer box is, but I'm fairly certain that Google Search is profitable. The Google Home speaker voice recognition is also powered by ML models.
- nr2x 4y ago
  Assistant however never made money.
kenjackson 4y ago
TikTok uses a bunch of AI. From their algorithm for the FYP. To vision for classification of videos. And sound processing to bucket sounds/music. This feeds into their rec engine as well as their safety engine.

by medler 4y ago

dougmwne 4y ago

Github Copilot seems like a pretty clear example. They charge a subscription that's in excess of the marginal cost of inference.

medler 4y ago
That’s a good point. I forgot about Copilot.
- visarga 4y ago
  Midjourney, NaturalReaders (text to speech reader)
andygeorge 4y ago
curious if/when MS will get desirable returns on the significant investment needed to run/train copilot
- dougmwne 4y ago
  It's a good question, but also helpful to point out that one of the beauties of these models is that you can train them once and deploy to many use cases. The same model can be used by Github, Bing, Office 365, Azure and so on. And as for the big multi-billion investment in OpenAI, they may have more than made that back up on their valuation already. Plus the deal was structured that OpenAI would pay it's revenues into Microsoft till the investment was paid back and MS would sill end up with a 49% stake. All in all, sounds like a smart investment from MS and, cerry on top, managed to majorly embarrass a main rival.
  - andygeorge 4y ago
    agree on it being a good play by MS. will interesting to see if they do spin it out to their other realms
- zamnos 4y ago
  The question there is how many of the estimated 100,000 software engineers at Microsoft are using Copilot, and what has been their (I'm sure measured) productivity boost. Microsoft does derive some benefit from Copilot being accessible to the paying subscribers of the world from having them give feedback and in free (and paid) press. But the internal use numbers probably easily justify its initial cost to train. Say Copilot makes an engineer 2x as productive, their all-in salary is $500k to make the math easy, 1,000 MS sw engineers are using it, and Copilot took $5mm to train (GPT-3 took $4.6mm). Those 1k MS employees now being twice as productive are doing the work of an extra 1k people at $500k, or $500 million's worth in a year. That means $5 million in Copilot training costs are paid for in... 4 days. I have no inside information, so those number are all made up, but I'm pretty sure the initial training costs have already been paid off internally. We also don't know how many multiples of $5mm it took to produce the initial version of Copilot, nor how many subsequent training runs there have been. Point is, any significant productivity gains made, across an organization the size of Microsoft engineering, easily pays for big expensive training runs.
  - deleted 4y ago
    [deleted]
  - ssijak 4y ago
    It makes tou nowhere nearly 2x productive. Usefull yes but 2x is a dream
  - visarga 4y ago
    SOME parts of an engineer's work are 2x faster, but not all. Generating code - yes, writing tests and docs - yes, designing the system - no, debugging - no, attending meetings - no, getting your data faster, or moving the other team to finish integration sooner - no help. So it's going to be 10% boost overall, not 100%. The nice effect is that the AI makes people more confident to try things and go out of their comfort zone. Maybe the quality of the end product will be higher.
- blackoil 4y ago
  If the return are computed by increase in market cap, they may already have got that.
  - deleted 3y ago
    [deleted]
deanc 4y ago
I’d be astonished if they’re even close to breaking even on copilot. In its current incarnation it wouldn’t even lace the boots of what’s coming out of OpenAI. CopilotX with its OpenAI collab will be the real winner - if it ever gets released to those on the waitlist. I’m not aware of anyone who got in yet, which leads me to believe it doesn’t yet exist.
- deleted 4y ago
  [deleted]
- bugglebeetle 4y ago
  I got access to the Copilot CLI, which is supposed to be part of the Copilot X package eventually. Dunno anyone who has gotten access to Copilot Chat yet, which I expect is what everyone really wants.
- Aeolun 4y ago
  > In its current incarnation it wouldn’t even lace the boots of what’s coming out of OpenAI. I don’t know about you, but Copilot is part of my daily work, while OpenAI ChatGPT is still more or less a toy to me.
- fastball 4y ago
  Copilot is already "backed" by OpenAI – it uses Codex under the hood which is a fine-tuned GPT-3 model. CopilotX is not a paradigm shift, it's a version change from GPT-3 to GPT-4.
  - visarga 4y ago
    GPT4 is arguably much better at coding, hence the "paradigm shift".
- Kiro 4y ago
  Copilot is and has always been OpenAI so not sure what you're talking about.

riffraff 4y ago

if you consider Spotify recommendations as AI then you should consider also Youtube and every social network based on a non-time based timeline and ads, no?

gilbetron 4y ago

I've seen MidJourney's estimated revenue at about $750k/month. Not bad.

yunwal 4y ago
This seems likely lower than their costs. Is there a breakdown somewhere?

paxys 4y ago

OpenAI is growing revenues from ~0 in 2022 to $300M in 2023 to $1B in 2024. That sounds like a product to me.

tensor 4y ago
"Hopes to grow" revenues. Current estimates put hardware costs alone at $700k/day, so even if they hit $300M in 2023 that won't make them profitable. This isn't even counting the people costs and other operation costs required to run a company. edit: order of magnitude was wrong on costs per day.
- vasco 4y ago
  Do you have the order of magnitude right at $700/day? That's not much at all.
- generalizations 4y ago
  And yet, $300M is only 1.25M subscribers at the current $20/mo rate. If we say that they need a $1B / year to be comfortably profitable, that's ~4.2M subscribers. A good rule of thumb is that you can hope to convert about 10% of your free user base to paid; one random source says they have 100M monthly active users - which at 10% conversion, is $2.4B / year. I think they'll be fine.
  - illiarian 4y ago
    How much money will they spend servicing requests for those 4.2M subscribers?
  - ZephyrBlu 4y ago
    10% is insanely high conversion for B2C freemium. It’s closer to 1% for most products.
    - anonylizard 4y ago
      Does GPT-4 look like 'most products'? You are talking about a revolutionary product that literally dominates mindshare from consumers to students to CEOs to governments. Its a pure monopoly that has insanely wide utility and instantly obvious value proposition.

Takennickname 4y ago

GPT API is a successful product. All those start ups that are just a thin layer over GPT that are funded by YCombinator are paying for API use and that's profitable for OpenAI.

nomel 4y ago
> and that's profitable for OpenAI. Reference? "Profitable" means they're making more money than they're using, at this moment.
- Takennickname 4y ago
  Are you implying openai is selling access to their API at a loss?
  - nomel 4y ago
    No, I would like facts, not assumptions. It's definitely not safe to assume they are making a profit, as a whole, or per transaction. It's more complicated than that. Profit has a strict definition of $revenue - $cost, for a business operation as a whole, which leaves money in the bank at the end of the month. They could be making more money for a single query than the cost of compute time for that single query, but that may not cover the engineering and idle servers. They could be running at a loss with the assumption that they can improve efficiency per transaction soon. They could be running at a "loss" because they're giving some of the compute away for free right now, to improve the training with the user responses. Or maybe they are making fistfuls of money. "Profitable" has a strict meaning, shouldn't be assumed, and definitely isn't required, at this point in their operation. I'm very interested to know if they are profitable, at the moment, but I don't think that's been publicly disclosed yet, and I can't find anything. A reference is required.
    - Takennickname 4y ago
      I don't have a reference. I'm taking the very reasonable assumption that openai is making money on API calls based on how much they charge compared to others in this space, the favorable pricing they receive from Microsoft, their ability to constantly bring down the costs and push the savings to their consumers, their unwillingness to lower the cost of Dall-E even though it's more expensive than it's competitors. Very reasonable assumptions. You will never get certainty, even if they say they're profitable maybe they're just lying for investors. If you see their bank account total go up every month maybe it's a ponzi scheme. For my heuristics, if not profitable, at least close, and definitely a major success in acquiring market share and customer mind share.

nr2x 4y ago

I use GPT about 100x more than search now for my day to day work. I pay them $20/mo. I’d likely pay $100 or more for the value I’m getting. They’ll figure it out.

zamnos 4y ago

How do you want to define AI? Google's been using ML models to power various Google products for years. Translate was a big switch over, back in 2016, and it powers the Google Search answer box. I have no idea how profitable that answer box is, but I'm fairly certain that Google Search is profitable. The Google Home speaker voice recognition is also powered by ML models.

nr2x 4y ago
Assistant however never made money.

kenjackson 4y ago

TikTok uses a bunch of AI. From their algorithm for the FYP. To vision for classification of videos. And sound processing to bucket sounds/music. This feeds into their rec engine as well as their safety engine.