4 ms·
> I wouldn't even be surprised if they were losing money on paying ChatGPT users on inference compute alone I'd be surprised it that was the case. How many tok
by JamesBarney 2y ago
> I wouldn't even be surprised if they were losing money on paying ChatGPT users on inference compute alone
I'd be surprised it that was the case. How many tokens is the average user going through? I'd be surprised if the avg user even hit a 1m tokens much less 20m.
- lxgr 2y agoWith o1? A lot. Even for regular old 4o: You’re comparing to their API rates here, which might or might not cover their compute cost.
- MacsHeadroom 2y agoo1 is about $2-$4 per message over the API. I'm probably costing OpenAI less than 24hrs after my subscription renewal each month. Voice mode is around $0.25 per minute via API. I don't use that much, but 3 minutes ago per day would already exceed the cost of a ChatGPT Plus subscription by quite a bit.
- vintagedave 2y ago> o1 is about $2-$4 per message over the API I’m not sure I understand this, sorry. I see GPT-4o at $3.75 per million input tokens and $10 per million output tokens, on OpenAI’s pricing page. That’s expensive and I can’t see how they can run Copilot on the standard API pricing. But, it makes a message (one interaction?) lower cost than $4 to me. How many tokens are in a typical message for you?