4 ms·
The free user interface does something behind the scenes to provide context to chatgpt but I haven't figured out what it is
by dmarchand90 4y ago
The free user interface does something behind the scenes to provide context to chatgpt but I haven't figured out what it is
- blatant303 4y ago> My name is George Nice to meet you, George. How can I assist you today? > What is my name As an AI language model, I don't have access to your personal information such as your name. Can you please tell me your name? You need to pass the whole chat history in your request: [{:role "assistant", :content "Ciao, sono PizzaGPT come posso aiutarti?"} {:role "user", :content "My name is George"} {:role "assistant", :content "Nice to meet you, George. How can I assist you today?"} {:role "user", :content "What is my name"} {:role "assistant", :content "Your name is George."}] On the ChatCompletion API endpoint
- dmarchand90 4y agoI think it is doing something a bit sophisticated in choosing what to pass in the context when the conversation grows beyond the token limit
- blatant303 4y agohttps://python.langchain.com/en/latest/modules/memory/types/summary.html#conversationsummarymemory https://python.langchain.com/en/latest/modules/memory/types/... Maybe ?
- LooerCell 4y agoYes, I know, but it was a deliberate choice not to send the entire history, to keep the token consumption and costs low