5 ms·
I think this can be easily fixed, if LLM can do notes on what's going on. If it will have additional context before the prompt: ``` You are home assistant. He
by pplonski86 3y ago
I think this can be easily fixed, if LLM can do notes on what's going on. If it will have additional context before the prompt:
```
You are home assistant. Here is information what's going on in the house:
It's 4PM.
Bob likes Chopin Fantaisie-Impromptu.
Alice likes Mozart Rondo in D.
Bob is in the house. Alice will be back from office at 5PM.
You get a prompt:
I'm tired, play my favorite
```
For the above input any LLM will play Chopin.
- troupo 3y agoWhere is that input coming from?
- pplonski86 3y agoIt's just example, I've manually created it. But I think LLM can do such memory notes for itself and include as context.
- koolba 3y agoMemory notes by an LLM for its own consumptions reminds me of the Polaroids in the movie Momento.
- wizzwizz4 3y agoAt least those were deliberate.
- pplonski86 3y agoNice analogy - yes, something like this. What is more, LLM notes can be hierarchical, to have some kind of generalization.
- troupo 3y agoSo, an LLM that has no context, and must have context provided to it via notes, prompts etc. will somehow create these notes for itself?
- sebzim4500 3y agoExactly, you'd use a section of the context as a permanent scratch pad. There are a few existing techniques (e.g. tree of thoughts) that look a bit like this.
- troupo 3y agoHow would that "scratch pad" be filled? Let me remind you of the context of the conversation: we're asking LLM to play a favorite song.
- d-lisp 3y agoYou need some kind of sidekick model to watch for the output of the LLM in order to spot sentences where the LLM e.g. "doesn't know about your favourite song". This model would trigger a custom prompt to fill the scratch pad : Your are Bob, your favourite song is ___. The model would act as a middleware and inject scratch pad information to each prompt you address to the LLM.
- troupo 3y agoAnd that model knows about things like "favorite songs"... how exactly? And about 1 million other things required to build the notes in the original comment? Or is it models all the way down?
- d-lisp 3y agoI think the model should only know about spotting some kind of token the LLM has the order to give when it doesn't know something related to your personal taste. It is technically possible (I insist on technically) for the LLM to be moderated in such a way that it retains itself from hallucinating your personal tastes, in the same way it is actually possible for gpt models to give answers such as "As a trained language model, I cannot blablabla" when certain conditions are met. From here, you have to imagine the scratch pad to be a sort of manual file you have the responsability to feed in order for the LLM to have the necessary context to answer your request. The sidekick model is there only to trigger the condition "something must be added to the scratch pad, due to the appearance of a certain token in the LLM response". I can imagine building something like this in emacs, where a buffer containing the scratch pad is opened on the sidekick demand : you have the responsability to enter "Bob's favourite song is X", or maybe the sidekick is able to extract elements of the LLM answer to propose " The LLM failed to answer when you asked, as user Y : What is my favourite song ?". The sidekick can be very simple as I said, this depends on the ability for your LLM to be moderated. GPT4's answer to the "What is my favourite song ?" : I don't have access to personal data about someone unless it has been shared with me in the course of our conversation. I am designed to respect user privacy. So, I don't know what your favorite song is unless you tell me. What is it? I can add instructions to every prompt I perform so that GPT4 says "Please input X" when it lacks X information about me to answer. Hello, what's my favourite song ? Answer: Please input your favourite song: The middleware recognize the form "Please input X", opens the scratchpad buffer, adds : Favourite song: And you type your favourite song here. The scratchpad may have some kind of sentence like " Here is a list of things about me you should remember." That helps contextualizing content for the LLM.