5 ms·

> Regarding the AI, it’s literally just a wrapper of OpenAI completions API (turbo-3.5 model) and a chat interface, so it should give the same answers as the fr

• LooerCell 4y ago
  Not really had much time to test the results. Yeah it should be possible to tweak the settings (mostly temperature and prompt) to get better results. Also I think I’m not sending the full history right now, to avoid consuming too many tokens
  • kgeist 4y ago
    >Also I think I’m not sending the full history right now, to avoid consuming too many tokens You can ask it to summarize the dialog, thus compressing the dialog history into a few sentences. That will give you some basic dialog context.
• dmarchand90 4y ago
  The free user interface does something behind the scenes to provide context to chatgpt but I haven't figured out what it is
  • blatant303 4y ago
    > My name is George Nice to meet you, George. How can I assist you today? > What is my name As an AI language model, I don't have access to your personal information such as your name. Can you please tell me your name? You need to pass the whole chat history in your request: [{:role "assistant", :content "Ciao, sono PizzaGPT come posso aiutarti?"} {:role "user", :content "My name is George"} {:role "assistant", :content "Nice to meet you, George. How can I assist you today?"} {:role "user", :content "What is my name"} {:role "assistant", :content "Your name is George."}] On the ChatCompletion API endpoint
    • dmarchand90 4y ago
      I think it is doing something a bit sophisticated in choosing what to pass in the context when the conversation grows beyond the token limit
      • blatant303 4y ago
        https://python.langchain.com/en/latest/modules/memory/types/summary.html#conversationsummarymemory https://python.langchain.com/en/latest/modules/memory/types/... Maybe ?
    • LooerCell 4y ago
      Yes, I know, but it was a deliberate choice not to send the entire history, to keep the token consumption and costs low