3 ms·
Interesting, but why use ChatGPT in an API instead of GPT-4?
by jasfi 4y ago
Interesting, but why use ChatGPT in an API instead of GPT-4?
- dragonwriter 4y agoGPT-4 (depending on which model and whether you look at prompt vs. response tokens) is between 15 and 60 times the cost per token of GPT-3.5. Also, GPT-4 API is doing a slow roll-out, so unless you’ve been granted access, you may not have access to it at all.
- BoorishBears 4y agoAs the other reply brought up, GPT-4 access is waitlisted, and costs significantly more API access makes it easy to chew through a lot of tokens. With GPT3.5 I hardly have to think about the cost of tinkering for hours on end. Yesterday I made over 600 requests and wracked up a whopping 67 cent bill... At an order of magnitude more, I'd still tinker, but wouldn't feel comfortable with all of the same usecases (ie. setting it up in ways that allow it to recurse very quickly like I do with 3.5)