4 ms·
This is explained in the OpenAI docs. There is a chat completion API and you pass in the prior messages from both the user and the assistant.
by cmelbye 4y ago
This is explained in the OpenAI docs. There is a chat completion API and you pass in the prior messages from both the user and the assistant.
- kgeist 4y agoI used the same trick with the previous GPT3 API (da-vinci) and it worked well, I'd pass as one big prompt: User: hello (previous prompt) Bot: hi (previous response) User: who are you? (new prompt) Bot: (here it continues conversation) I wonder how the new ChatGPT API differs, other than the fact that it's structured (you use JSON to represent the conversation memory separately instead of one large prompt). I guess I will spend the next day playing around with the new API to figure it out.
- kgeist 4y agoJudging by this[0] the new structured format is immune to "injections": [0] https://github.com/openai/openai-python/blob/main/chatml.md https://github.com/openai/openai-python/blob/main/chatml.md