4 ms·
That reminds me ... You know how LLMs have a hard time being corrected? If I ask it not to format responses as bullet lists, after 1-2 rounds it does it again.
by visarga 3y ago
That reminds me ... You know how LLMs have a hard time being corrected? If I ask it not to format responses as bullet lists, after 1-2 rounds it does it again. Why? Because the context is filled with examples where it has used bullet lists, and it acts like an attractor.
I ask it not to start phrases with "However..." and it does it again. Maybe just having the word However in the prompt acts like an attractor that compels the LLM to use it, even when I actually asked the opposite. Probably also the fault of heavy handed RLHF telling it to balance any user position with the opposite take.
- lupire 3y agoThis is one of many ways of LLMs are being crippled by terrible UI controls. You can't do simple things like edit the conversation history to make it forget things.
- gkbrk 3y agoYou can edit the conversation history though. You need to try alternative apps/UIs instead of the product websites like ChatGPT. Those are only for collecting more training data from users instead of being the most useful interface possible.
- hnben 3y agoif you haven't already, I recommend trying the openai playground instead of chatgpt. It is the same underlying ai (i.e. gpt4), but you have much more control over the inputs. Bonus 1: Since you pay per token, it's much cheaper than a chatgpt abo Bonus 2: You can increase the context window dramatically (iirc 8000 being the max for playground, while 2000 is the max for chatgpt)
- dmd 3y agoUsing a 3rd party interface to the LLMs (like typingmind.com) is both better and cheaper than using chatgpt.
- astrange 3y agoFacebook had a paper about "system 2" LLM attention, where they identified which parts of the input would be distracting for the LLM and just deleted them. https://arxiv.org/abs/2311.11829 https://arxiv.org/abs/2311.11829