3 ms·
A useful 1a for ChatGPT specifically is BabyAGI-style "what their current/next objective is." There are vector database solutions that address the forgetting o
by jstarfish 3y ago
A useful 1a for ChatGPT specifically is BabyAGI-style "what their current/next objective is."
There are vector database solutions that address the forgetting of context. Oobabooga has superbooga (chromadb), SillyTavern requires the headache of the Extras service but will let you use chromadb, Google or OpenAI. Koboldcpp doesn't do vectorization, but does have a clunky autogenerate-summary feature that injects a summary of events so far into the prompt.