3 ms·
Tell HN: OpenAI says they might add a new subscription level for more GPT4 limit
When hitting the GPT4's usage limit (which is now 25 messages per 3 hours), OpenAI shows a link to a form where they mention their plans for GPT4 users.
- retrac 4y agoThe compute costs must be extraordinary. As I understand it, inference needs, very roughly, something like 200 GB of RAM and multiple high-end GPUs/vector coprocessors, to give output not much faster than a person can type. A VM on AWS of that class costs several dollars an hour. If there are 10,000 simultaneous users running inference (a low estimate, surely) then ChatGPT is probably costing Microsoft/OpenAI tens of thousands of dollars per hour, or millions per week? They have deep pockets for what is some great advertising, I imagine. But this couldn't possibly continue for free indefinitely with how much people are using it. Does anyone have more details on just what kind of resources GPT-4 needs to run inference?
- brianjking 4y agoWhere is this form? I've not seen it anywhere. Source? This is what displays when using GPT-4 on ChatGPT Plus. https://imgur.com/59XT6O9 https://imgur.com/59XT6O9
- behnamoh 4y agoWhen you finish your quota, it shows you a link.
- brianjking 4y agoScreenshot? Link to said form?