4 ms·

Unless you're an extremely heavy user, it's cheaper to just use the API. I've been tempted to do that, but OpenAI doesn't have a free trial for me to see the qu

Unless you're an extremely heavy user, it's cheaper to just use the API. I've been tempted to do that, but OpenAI doesn't have a free trial for me to see the quality of GPT-4 first.

latchkey 3y ago
$20/mo... ~$1.3 day. I'm good with "vastly cheaper than a latte" pricing model and $20 to try something out for a month isn't bad at all.
- Spivak 3y ago
  Right but the API is so unbelievably cheap in comparison. I couldn't spend $20 if I tried using it constantly. My bill is a few bucks every month and you don't have to deal with "As a large language model…"
  - Tokumei-no-hito 3y ago
    > and you don't have to deal with "As a large language model…" what do you mean? is the API uncensored?
    - Spivak 3y ago
      I don't know if it's entirely uncensored but it doesn't have the moderation API in front of it or the other manual tweaks OpenAI added to ChatGPT so largely it will just do whatever you ask it to without paragraphs of disclaimers.
vunderba 3y ago
I'm astonished how often this comes up and also how wrong it is. The cost of the GPT-4 API is ballpark around $0.05 / 1000 tokens. If you want to include a rolling context window which you basically HAVE TO DO if you want to maintain a persistent conversation, you will easily meet or exceed 1000+ tokens. ChatGPT Pro gives you 50 GPT-4 queries every three hours. If you're using it all day you might average about 100 daily queries. Using a dedicated GPT4 API would run you approximately five dollars a day for the same thing - that's $150 a month as opposed to flat cost of $20.
- Spivak 3y ago
  I think you're being really wasteful with that kind of context window which is why it's a bit apples and oranges. I keep stats on this, my average message is around 50 tokens, the average individual response is around 200 tokens, and my average conversion length is 1.2 (only counting my messages). 50/convos/day * 30 days is $21 and I don't come close to that usage. Hell most of the time I don't even turn on GPT-4 because 3.5-instruct is plenty good.
  - latchkey 3y ago
    Your usecase is that you don’t really use it very much, don’t want the advanced features and you’re arguing over $20 a month. We are in a different category.

Unless you're an extremely heavy user, it's cheaper to just use the API. I've been tempted to do that, but OpenAI doesn't have a free trial for me to see the quality of GPT-4 first.

latchkey 3y ago

$20/mo... ~$1.3 day. I'm good with "vastly cheaper than a latte" pricing model and $20 to try something out for a month isn't bad at all.

Spivak 3y ago
Right but the API is so unbelievably cheap in comparison. I couldn't spend $20 if I tried using it constantly. My bill is a few bucks every month and you don't have to deal with "As a large language model…"
- Tokumei-no-hito 3y ago
  > and you don't have to deal with "As a large language model…" what do you mean? is the API uncensored?
  - Spivak 3y ago
    I don't know if it's entirely uncensored but it doesn't have the moderation API in front of it or the other manual tweaks OpenAI added to ChatGPT so largely it will just do whatever you ask it to without paragraphs of disclaimers.

vunderba 3y ago

I'm astonished how often this comes up and also how wrong it is. The cost of the GPT-4 API is ballpark around $0.05 / 1000 tokens. If you want to include a rolling context window which you basically HAVE TO DO if you want to maintain a persistent conversation, you will easily meet or exceed 1000+ tokens. ChatGPT Pro gives you 50 GPT-4 queries every three hours. If you're using it all day you might average about 100 daily queries. Using a dedicated GPT4 API would run you approximately five dollars a day for the same thing - that's $150 a month as opposed to flat cost of $20.

Spivak 3y ago
I think you're being really wasteful with that kind of context window which is why it's a bit apples and oranges. I keep stats on this, my average message is around 50 tokens, the average individual response is around 200 tokens, and my average conversion length is 1.2 (only counting my messages). 50/convos/day * 30 days is $21 and I don't come close to that usage. Hell most of the time I don't even turn on GPT-4 because 3.5-instruct is plenty good.
- latchkey 3y ago
  Your usecase is that you don’t really use it very much, don’t want the advanced features and you’re arguing over $20 a month. We are in a different category.