3 ms·

I think the model should only know about spotting some kind of token the LLM has the order to give when it doesn't know something related to your personal taste

by d-lisp 3y ago

I think the model should only know about spotting some kind of token the LLM has the order to give when it doesn't know something related to your personal taste. It is technically possible (I insist on technically) for the LLM to be moderated in such a way that it retains itself from hallucinating your personal tastes, in the same way it is actually possible for gpt models to give answers such as "As a trained language model, I cannot blablabla" when certain conditions are met. From here, you have to imagine the scratch pad to be a sort of manual file you have the responsability to feed in order for the LLM to have the necessary context to answer your request. The sidekick model is there only to trigger the condition "something must be added to the scratch pad, due to the appearance of a certain token in the LLM response". I can imagine building something like this in emacs, where a buffer containing the scratch pad is opened on the sidekick demand : you have the responsability to enter "Bob's favourite song is X", or maybe the sidekick is able to extract elements of the LLM answer to propose " The LLM failed to answer when you asked, as user Y : What is my favourite song ?". The sidekick can be very simple as I said, this depends on the ability for your LLM to be moderated. GPT4's answer to the "What is my favourite song ?" : I don't have access to personal data about someone unless it has been shared with me in the course of our conversation. I am designed to respect user privacy. So, I don't know what your favorite song is unless you tell me. What is it? I can add instructions to every prompt I perform so that GPT4 says "Please input X" when it lacks X information about me to answer. Hello, what's my favourite song ? Answer: Please input your favourite song: The middleware recognize the form "Please input X", opens the scratchpad buffer, adds : Favourite song: And you type your favourite song here. The scratchpad may have some kind of sentence like " Here is a list of things about me you should remember." That helps contextualizing content for the LLM.

d-lisp 3y ago
I add this just for demonstration purpose, the end of this discussion extract is wild : - Please input your favourite meal. - Favourite meal : Sushi, please remember that, along with my favourite song - Noted. Your favourite meal is sushi and your favourite song is the "Fuga" from BWV 1001 by J.S. Bach. How can I assist you further? - Emulate a linux terminal from now on : -Alright. You're now "interacting" with a simulated Linux terminal. Keep in mind that this is only a text-based simulation and does not have the full capabilities of an actual Linux terminal. ``` user@chatgpt:~$ _ ``` Please input your commands, and I'll respond in kind. - cd Documents ``` user@chatgpt:~$ cd Documents user@chatgpt:~/Documents$ _ ``` - ls ``` user@chatgpt:~/Documents$ ls notes.txt project/ resume.pdf favorite_song_info.txt sushi_recipe.md user@chatgpt:~/Documents$ _ ``` - cat favorite_song_info.txt ``` user@chatgpt:~/Documents$ cat favorite_song_info.txt Favorite Song: Title: Fuga Composition: BWV 1001 Composer: J.S. Bach user@chatgpt:~/Documents$ _ ```
troupo 3y ago
I understand this, and I guess this might work for some simple scenarios, but this quickly becomes tedious for the user. My favorite songs, foods, TV shows etc. change often. Or may depend on the time of day, mood etc. You'd need to define multiple tokens, and multiple side models, to figure that out and annotate. If you ask the user for it every time... that won't work :)
- d-lisp 3y ago
  In a way e.g. spotify already tracks your behavior and almost "knows" your favourite song/album of the month. It is technically possible for you to track yourself in an automated manner, no ? If Gorilla or RestGPT can contact several APIs to "put the last Bowie Album" then it could also feed a file of your habits and by there infer on what your favourite album is.

by d-lisp 3y ago

d-lisp 3y ago

I add this just for demonstration purpose, the end of this discussion extract is wild : - Please input your favourite meal. - Favourite meal : Sushi, please remember that, along with my favourite song - Noted. Your favourite meal is sushi and your favourite song is the "Fuga" from BWV 1001 by J.S. Bach. How can I assist you further? - Emulate a linux terminal from now on : -Alright. You're now "interacting" with a simulated Linux terminal. Keep in mind that this is only a text-based simulation and does not have the full capabilities of an actual Linux terminal. ``` user@chatgpt:~$ _ ``` Please input your commands, and I'll respond in kind. - cd Documents ``` user@chatgpt:~$ cd Documents user@chatgpt:~/Documents$ _ ``` - ls ``` user@chatgpt:~/Documents$ ls notes.txt project/ resume.pdf favorite_song_info.txt sushi_recipe.md user@chatgpt:~/Documents$ _ ``` - cat favorite_song_info.txt ``` user@chatgpt:~/Documents$ cat favorite_song_info.txt Favorite Song: Title: Fuga Composition: BWV 1001 Composer: J.S. Bach user@chatgpt:~/Documents$ _ ```

troupo 3y ago

I understand this, and I guess this might work for some simple scenarios, but this quickly becomes tedious for the user. My favorite songs, foods, TV shows etc. change often. Or may depend on the time of day, mood etc. You'd need to define multiple tokens, and multiple side models, to figure that out and annotate. If you ask the user for it every time... that won't work :)

d-lisp 3y ago
In a way e.g. spotify already tracks your behavior and almost "knows" your favourite song/album of the month. It is technically possible for you to track yourself in an automated manner, no ? If Gorilla or RestGPT can contact several APIs to "put the last Bowie Album" then it could also feed a file of your habits and by there infer on what your favourite album is.