5 ms·
ChatGPT API is surprisingly cheap, but GPT-4 is many times more expensive to the point where I can't see it being worth it most of the time.
by ronsor 4y ago
ChatGPT API is surprisingly cheap, but GPT-4 is many times more expensive to the point where I can't see it being worth it most of the time.
- stavros 4y agoI'm not convinced that the GPT-4 API actually works? It's been giving me very different answers than the chat interface. For example, the chat interface says it's GPT-4 if you ask it, but the API says it's GPT-3 (and bills as GPT-4).
- siva7 4y agoIf you're satisfied with the results who cares what it thinks it is
- stavros 4y agoI'm not. It's worse than the chat version.
- johntb86 4y agoWhy would the LLM model know what version it actually is? It was trained on data from before that model version even existed.
- stavros 4y ago- What version model are you? - I am based on the GPT-4 architecture, which is an iteration of OpenAI's Generative Pre-trained Transformer models. My training data includes information up to September 2021. - How do you know your version? - As an AI language model, I am programmed with information about my own architecture and the version I am based on. My creators at OpenAI provided me with this knowledge, which helps me to give context to users about my capabilities and limitations. In this case, I am based on the GPT-4 architecture, an iteration of OpenAI's Generative Pre-trained Transformer models.
- roflyear 4y agoLikely making this up.
- stavros 4y agoWhy did it not make up GPT-5 or something else, though?
- HopenHeyHi 4y agoTry asking it several times with slightly different phrasings.
- roflyear 4y agoI don't have all the answers!
- trevyn 4y agoHas the ChatGPT-4 “system” prompt been revealed?
- stavros 4y agoHmm, you think that's what makes a difference? It might be, though I've gotten different (what I find worse) results on other questions as well.
- trevyn 4y agoThis is a great (pre-GPT-4) post that goes into the system prompt and its effects: https://minimaxir.com/2023/03/new-chatgpt-overlord/ https://minimaxir.com/2023/03/new-chatgpt-overlord/ Are you using any system prompt in your API calls? Note that it does have an explicit domain separation from the user and assistant roles. I suspect it plays a greater role in GPT-4 as well, i.e. was trained on a wider variety of system prompts to guide the output of the model.
- stavros 4y agoI wasn't, no. You're right, that might make a difference. Thanks for the article, it's very useful, I've been curious about the system prompt!