3 ms·

i dont believe this for a second. Inference margins are huge, if they stopped R&D tomorrow they would be making an incredible amount of money, but they cant sto

i dont believe this for a second. Inference margins are huge, if they stopped R&D tomorrow they would be making an incredible amount of money, but they cant stop investing because they have competitors. its all pretty simple

scarface_74 1y ago
Do we have any evidence of this that inference costs are less than the subscription price?
- oblio 1y ago
  No, and nobody claiming this seems to be posting evidence when confronted. I guess we'll find out in 2-3 years.
deleted 1y ago
[deleted]
majewsky 1y ago
This is unrelated to the original assertion: "If they charged users what it actually costs to run their service, almost nobody would use it." 5 million paying customers on 800 million overall active users is an absolutely abysmal conversion rate. And that's counting the bulk deals with extreme discounts (like 2.50 USD/month/seat) which can only be profitable if a significant number of those seats never use ChatGPT at all.
- anthonypasq 1y ago
  youre assuming that if chatgpt suddenly cost $20 a month to access at all that 795 million people would never talk to chatgpt again?
glenneroo 1y ago
I don't know if the site is just broken for me at the moment, but this has used to track how much people were costing the companies (based on tokens per $ if I remember correctly): https://www.viberank.app/ https://www.viberank.app/ One user in particular ran up a $50k bill for 1 month of usage, while paying $200 for the month: https://bsky.app/profile/edzitron.com/post/3lwimmfvjds2m https://bsky.app/profile/edzitron.com/post/3lwimmfvjds2m Plenty of people are to blow through resources pretty quickly, especially when you have non-deterministic output and have to hit "retry" a few times, or back-and-forth with the model until you get what you want, whereby each request adds to total tokens used in the interaction. AI companies have been trying to clamp down but so far unsuccessful, and it may never be completely possible without alienating all of their users.

scarface_74 1y ago

Do we have any evidence of this that inference costs are less than the subscription price?

oblio 1y ago
No, and nobody claiming this seems to be posting evidence when confronted. I guess we'll find out in 2-3 years.

deleted 1y ago

[deleted]

majewsky 1y ago

This is unrelated to the original assertion: "If they charged users what it actually costs to run their service, almost nobody would use it." 5 million paying customers on 800 million overall active users is an absolutely abysmal conversion rate. And that's counting the bulk deals with extreme discounts (like 2.50 USD/month/seat) which can only be profitable if a significant number of those seats never use ChatGPT at all.

anthonypasq 1y ago
youre assuming that if chatgpt suddenly cost $20 a month to access at all that 795 million people would never talk to chatgpt again?

glenneroo 1y ago

I don't know if the site is just broken for me at the moment, but this has used to track how much people were costing the companies (based on tokens per $ if I remember correctly): https://www.viberank.app/ https://www.viberank.app/ One user in particular ran up a $50k bill for 1 month of usage, while paying $200 for the month: https://bsky.app/profile/edzitron.com/post/3lwimmfvjds2m https://bsky.app/profile/edzitron.com/post/3lwimmfvjds2m Plenty of people are to blow through resources pretty quickly, especially when you have non-deterministic output and have to hit "retry" a few times, or back-and-forth with the model until you get what you want, whereby each request adds to total tokens used in the interaction. AI companies have been trying to clamp down but so far unsuccessful, and it may never be completely possible without alienating all of their users.