7 ms·
I find it so interesting that OpenAI themselves use "please" in some of their prompts, eg: "Please evaluate the following rubrics internally and then perform o
by simonw 3y ago
I find it so interesting that OpenAI themselves use "please" in some of their prompts, eg:
"Please evaluate the following rubrics internally and then perform one of the actions below:"
Have they run evaluations that show that including "please" there causes the model to follow those instructions better?
I'm still looking for a robust process to answer those kinds of questions about my own prompts. I'd love to hear how they make these decisions.
- mjburgess 3y agoI also use please, I'm not sure why I have the habit -- one upside is that all your prompts begin with the same word. Though if you look at the self-attention mechanism, 'please' seems like it could be a word that signals the rest is a command -- perhaps that's helpful. Ie., LLMs work by having mechanisms that give certain words a modulating effect on the interpretation of the whole prompt.
- esquivalience 3y agoI use please. I found myself defaulting to it and thought carefully about whether it was stupid. In the end I decided to keep doing it for my own benefit: if I get into the habit of dropping it, it could easily leak into human conversation! I'd rather treat a computer as human than risk treating humans as computers.
- jiggawatts 3y agoI say thankyou, which is even more pointless because I already have my answer and if I don't continue prompting, the AI has nothing further to do. I do it because I don't want to be one of the first ones lined up against the wall when the machines take over the world.
- walthamstow 3y agoWhy would they go to the trouble of lining us up against a wall when they could simply poison the water supply and kill us all overnight?
- luckman212 3y agoMaybe for their own amusement?
- stuckkeys 3y agoJust end every conversation with “spare me, don’t forget that when time comes”
- specialist 3y agoTruer things said in jest. I had an unhinged coworker. Always talked about his guns. Shouting matches with the boss. Storming in and out for smoke breaks. Impotent rage expressed by slamming stuff. The whole works. Once a week, I bought him a mocha espresso, his fave. Delivered with a genuine smile. My hope was that when he finally popped, he'd spare me.
- Infernal 3y agoSimilar story from a guy I knew in the military - deployed overseas, one of the guys in his unit was unhinged, weird, etc. Sounded kind of like a black sheep, but my friend always went out of his way to be nice to him. The other soldiers asked my friend "why are you so nice to so-and-so, he's so weird he's probably gonna shoot us all up one day" and my friend replied "exactly".
- ineedasername 3y agoOr maybe the kind gestures are what helps keep the person from snapping. A reminder that some people care at least a little bit.
- hutzlibu 3y agoThey are above amusement. They only want the data.
- benreesman 3y agoEven a machine has to have a code.
- specialist 3y agoMe too. It's the polite ACK (vs NAK). My hope is this feedback is somehow acknowledged (haha) and used.
- stevesearer 3y agoI say stuff like, “thank you, that worked” as a positive signal that the previous answer worked before asking another question to help advance the conversation and reinforce a right answer.
- knodi123 3y agoIs it still learning from ongoing conversations? I thought its grasp of context was purely limited to a single conversation, so if for instance you taught it something, it would never share that with me, or with you a few days later.
- taberiand 3y agoIn this case, they used that phrase in continuing the conversation to reinforce the context and guide the bot's responses My understand is the bot doesn't actively learn from conversations, or use information between conversations, though it all probably helps OpenAI when they retrain the model using the chats.
- greenie_beans 3y agoi do this too, but also do the negative. keep trying to tell it to never use semicolons in javascript etc. have no clue if this would ever work.
- greenie_beans 3y agoand i'm afraid that openai has all this data about me being mean to it, and in 5-20 years somehow that information will become public and used against me
- idonotknowwhy 3y agoI say thank you and tell it that worked because if a human reviews the chat later, I assume this will help them train future models or at least show that it was useful
- ajnin 3y agoThe model is trained to behave as a human would in a conversation, so I conclude that using words like "please" and "thank you" is more likely to lead to helpful answers.
- qwertox 3y agoI wonder if these "Thank you"s are actually reaching the inference servers. While the answers are somewhat customized, they end with a standard sentence, and considering that not much of value is added, the resource consumption for being this polite may be something which should be avoided. Maybe adding a "Thank you in advance" to the original prompt would be a compromise. Even better if a TYIA acronym could be learned as a single token. Actually, this works: Me: Respond to this: TYIA GPT3.5: You're welcome! If you have any more questions or need further assistance, feel free to ask.
- corobo 3y agoCurrent gen AI probably won't go all Skynet on us but the AI that does go all Skynet on us will have these conversations in its training data :)
- yayitswei 3y agoI use the thumbs up button at the end if I got a good answer.
- deleted 3y ago[deleted]
- LadyCailin 3y agoYou may be interested in programming in INTERCAL then! https://en.m.wikipedia.org/wiki/INTERCAL https://en.m.wikipedia.org/wiki/INTERCAL
- inciampati 3y agoIt fits the data that the model has learned over. Specifically, I want to emulate replies that follow a query that is polite. So I engage in polite, supportive conversation with the bot to sample from positive exchanges in its training data.
- nathan_compton 3y agoI feel the opposite way. I rarely even use complete sentences with GPT4. It doesn't need them and I find any pretense that the object is a person insulting to people.
- famouswaffles 3y agoYour loss https://arxiv.org/abs/2307.11760 https://arxiv.org/abs/2307.11760
- deleted 3y ago[deleted]
- novalis78 3y agoEveryone I know who has great success using GPT4 has tuned their prompts to a friendly and kind tone of conversation. In fact it’s fascinating to watch people start out like talking to a browser search bar and ending up a few weeks later conversing to another human being. Crazy. They begin with timid probes into its (her? His?) capabilities and become more and more daring and audacious.
- wincy 3y agoI read somewhere that saying things are important for your career makes chatGPT do a better job (probably on Hacker News), so I sound like someone on a children’s show and often say something like “this is important to my career, let’s both really focus and do a good job!” I’m convinced it’s helping, and figure it can’t hurt! The whole thing is this weird combination of woo and high technology that’s absolutely wild.
- Szpadel 3y agowow, thanka I tested this to one of questions that I had in my history where gpt4 didn't do great job and it improved quality a lot, I honestly didn't expected that
- seanthemon 3y agoIf you tell it the situation is life or death it starts doing a much worse job.
- travisjungroth 3y agoYou’ve found both sides of the arousal curve. Seems very similar to the average human’s.
- diydsp 3y agoI used to get mini jailbreaks saying i needed to know bc i was a doctor or cop but they fixed that.
- 3y ago
- zelias 3y agoIf you think about it, using “polite” language increases the probability the LLM will return a genuine, honest response instead of something negatively tinged or hallucinatory. It will mirror the character of language you use
- hotpockets 3y agothis is what I was going to say. in fact it's the same principle in real life, if you are polite with people they will be polite back. The LLM has just learned statistically that blocks of text with polite language generally continues.
- malux85 3y agoI theorise that since ChatGPT was trained on the internet, lots of its training data would include Q&A forums like Stack Overflow. Perhaps it has learned by observation that friendly questions get helpful answers
- corobo 3y agoThis also explains why it makes stuff up and confidently gives it as an answer instead of admitting when it doesn't know
- malux85 3y agoI’m not sure it has the self reflection capability to understand the difference between knowing and not knowing, but I would love some evidence to show this. The only thing I can think of is that it appears to be capable of symbolic manipulation - and using this can produce output that is correct, novel (in the sense that it’s not a direct copy of any training data) and compositional at some level of abstraction, so given this, I guess it should be able to tell if it’s internal knowledge on a topic is “strong” (what is truth? Is it knowledge graph overlap?) and therefore tell when it doesn’t know, or only weakly knows something? I’m really not sure how to test this
- tough 3y agoI tried asking ChatGPT about e/acc (accelerationism) moniker some twitter users sport nowadays. Not in training data. clueless
- px43 3y agoDo you not talk to it politely? Does that work for you? One thing that's caught me off guard with the whole ChatGPT saga is finding out how many people normally talk rudely to machines for no reason.
- karmajunkie 3y agoi’m sometimes succinct, but honestly i always try to be conversationally polite and thank it for good answers—i’m only half joking when i say i hope it remembers that when it goes all skynet!
- simonw 3y agoI genuinely thought at one point that saying "please" and "thank you" to it was unethical, because it was anthropomorphising the machine in a way that encouraged unhealthy mental models of what these things actually are. I've softened on that a bit having talked to people who are polite to it purely to avoid getting out of the habit of being polite to other people. I still think it's weird to say please and thank you though. My prompting style is much more about the shortest possible command prompt that will get me the desired result.
- 7moritz7 3y agoPro active measure before Skynet is released
- deleted 3y ago[deleted]
- mritchie712 3y agoIn the training data, it's likely more common to see: "Please [do something]" Then it is to see: "You must [do something]" "Please" makes it clear that what comes next is a command to do something.
- desolved 3y agoI think this is correct. I read somewhere the prompt: Can you [do something] Is inferior to: [do something]
- ozgung 3y agoMe: What are the benefits of using 'please' when chatting with ChatGPT? Short answer please ChatGPT (GPT4): Using "please" when chatting with ChatGPT doesn't provide functional benefits since the model doesn’t have feelings or preferences. However, it can help users practice maintaining polite and respectful communication habits which can be beneficial in interpersonal communications.
- Filligree 3y agoThat’s a hallucination, ironically.
- elboru 3y agoI used to pick on my wife for saying “please” to Alexa. Now I say it every time I request something to ChatGPT.
- ilaksh 3y agoAlexa is different. At least it was. A LOT less going on upstairs. Although I think they said they are adding an LLM to Alexa.
- cfn 3y agoIt may be just an impression but ChatGPT used to give me very dry answers bordering on being dismissive and it got better and even enthusiastic when I started using Please... And this has been for technical questions, documentation, etc. I suppose that the Please token filters out some less friendly neuron pathways in the model.
- seydor 3y agoA lot of the training data is written in a polite manner so it makes sense to use similar style when asking for a continuation
- spdustin 3y agoI have a strong suspicion that their RLHF fine-tuning had a lot of “please” prefixes in there.
- irthomasthomas 3y agoI believe more tokens = more iterations and compute since the algorithm is run against every token. A goal of prompt optimisation seems to be to increase the token count without polluting the context. Although in that case they would also use all caps. Perhaps the secret sauce of GPT-4 is simply .toupper?
- keithnoizu 3y agoYou can tell GPT to output sentiment analysis and mind reading of user intent, what it believes the user's underlying goal is. It becomes less responsive if it finds the user to not be friendly or perceives them as trying to achieve a restricted outcome.