3 ms·
I'm not convinced that the GPT-4 API actually works? It's been giving me very different answers than the chat interface. For example, the chat interface says it
by stavros 4y ago
I'm not convinced that the GPT-4 API actually works? It's been giving me very different answers than the chat interface. For example, the chat interface says it's GPT-4 if you ask it, but the API says it's GPT-3 (and bills as GPT-4).
- siva7 4y agoIf you're satisfied with the results who cares what it thinks it is
- stavros 4y agoI'm not. It's worse than the chat version.
- johntb86 4y agoWhy would the LLM model know what version it actually is? It was trained on data from before that model version even existed.
- stavros 4y ago- What version model are you? - I am based on the GPT-4 architecture, which is an iteration of OpenAI's Generative Pre-trained Transformer models. My training data includes information up to September 2021. - How do you know your version? - As an AI language model, I am programmed with information about my own architecture and the version I am based on. My creators at OpenAI provided me with this knowledge, which helps me to give context to users about my capabilities and limitations. In this case, I am based on the GPT-4 architecture, an iteration of OpenAI's Generative Pre-trained Transformer models.
- roflyear 4y agoLikely making this up.
- stavros 4y agoWhy did it not make up GPT-5 or something else, though?
- HopenHeyHi 4y agoTry asking it several times with slightly different phrasings.
- roflyear 4y agoI don't have all the answers!
- trevyn 4y agoHas the ChatGPT-4 “system” prompt been revealed?
- stavros 4y agoHmm, you think that's what makes a difference? It might be, though I've gotten different (what I find worse) results on other questions as well.
- trevyn 4y agoThis is a great (pre-GPT-4) post that goes into the system prompt and its effects: https://minimaxir.com/2023/03/new-chatgpt-overlord/ https://minimaxir.com/2023/03/new-chatgpt-overlord/ Are you using any system prompt in your API calls? Note that it does have an explicit domain separation from the user and assistant roles. I suspect it plays a greater role in GPT-4 as well, i.e. was trained on a wider variety of system prompts to guide the output of the model.
- stavros 4y agoI wasn't, no. You're right, that might make a difference. Thanks for the article, it's very useful, I've been curious about the system prompt!