3 ms·
I'm surprised nobody is mentioning one of the largest factors. If you're a heavy user of chatGPT, the equivalent cost of using the smallest GPT4 model would run
by vunderba 3y ago
I'm surprised nobody is mentioning one of the largest factors. If you're a heavy user of chatGPT, the equivalent cost of using the smallest GPT4 model would run you a hell of a lot more.
The cost of the GPT-4 API is ballpark around $0.05 / 1000 tokens. If you want to include a rolling context window, you will easily hit 1000+ tokens if not a huge amount more. ChatGPT pro gives you 50 GPT-4 queries every three hours. If you're using it all day you might average about 100 daily queries. Using a dedicated GPT4 API would run you approximately five dollars a day for the same thing - that's $150 a month as opposed to flat cost of $20.