4 ms·
Should We Respect LLMs? A Study on Influence of Prompt Politeness on Performance
- dr_dshiv 2y agoMachine psychology is a field now: https://arxiv.org/abs/2303.13988 https://arxiv.org/abs/2303.13988
- thatnerd 2y agoSam Altman doesn't want you to say "please" to ChatGPT. https://futurism.com/altman-please-thanks-chatgpt https://futurism.com/altman-please-thanks-chatgpt
- esafak 2y agoThat is not true; first he says it's "tens of millions of dollars well spent," followed by "you never know". I don't think he knows.
- lyjackal 2y agoI’ve wondered whether they use thanks as a signal to a conversation well done, for the purpose of future reinforcement learning
- itchyjunk 2y agoCasual twitter response turned into a new article turned into a "X wants Y" is exactly why I stopped trusting most of social media as a source of information.
- a3w 2y agoI end most conversations with a fuck you, then close the browser window. Since usually chatbots fail at the tasks I give them.
- hbbio 2y agoFrom the article: "the impacts of generating a 100-word email. They found that just one email requires .14 kilowatt-hours worth of electricity, or enough to power 14 LED lights for an hour" Seems completely off the charts. A 70b model on my M3 Max laptop does it for 0.001 kWh... 140x times less that stated in the article. Let's say the OpenAI Nvidia clusters are less energy efficient than my Macbook... but not even sure about that.
- bayindirh 2y agoFor reference, a single NVIDIA H200 card has a TDP of 700watts. Considering all the middlemen you put between you and the model, .14KWh doesn't look too outrageous to me. Because you add processors, high-speed interconnects, tons of cooling, etc. into the mix. Plus the models you run at the datacenters are way bigger. For "fathomability" case, the network cables (fibers in fact) you use in that datacenters carries 800gbps, and the fiber-copper interface converters at each end heats up to uncomfortable levels. You have thousands of these just converting packets to light and vice versa. I'm not adding the power consumption of the switches, servers, cooling infra, etc. into the mix. Yes, water cooling is more efficient than air cooling, but when a server is burning through 6KWh of energy (8x Tesla cards, plus processors, plus rest of the system), nothing is efficient as a local model you hit at your computer. Disclosure: Sitting on top of a datacenter.
- ben_w 2y agoOne can also work backwards, to see what kind of compute hardware they think must be needed for the models, or how much they think OpenAI's electricity costs. 100 words is ~133 tokens, so 0.14 kWh/133 tokens is about 1 kWh/kilo-token. If electricity is all from record-cheapest PV at $0.01/kWh, then this limits them to a price floor of $10/mega-token. For more realistic (but still cheap) pricing of $0.05/kWh, that's $50/mega-token. Here's the current price sheet: https://platform.openai.com/docs/pricing https://platform.openai.com/docs/pricing To generate a 133-token email in, say, 5 seconds, if it takes 0.14 kWh, is 101 kW. This does not seem like a plausible number (caveat: I don't work in a data centre and what I think isn't plausible may just be wrong): https://www.wolframalpha.com/input?i=0.14+kWh+%2F+5+seconds+in+watts https://www.wolframalpha.com/input?i=0.14+kWh+%2F+5+seconds+...
- deadbabe 2y agoI’m totally against the anthropomorphization of LLMs. These are tools, not sentient beings. Treat them as such. Unlike a power tool, they don’t need respect because they cannot hurt you. LLMs trying to simulate human behavior is like the equivalent of skeuomorphism in UI design.
- jdlshore 2y agoBecause LLMs match your prompt to data scraped off the internet, it’s plausible that being polite results in your response coming from more civil conversations that have more useful data.
- fnordpiglet 2y agoThey’re also language tools, built on the ingestion and training of language and its tone, form and application. The way they work, by inferring responses based on the probabilistic best response to your language prompt, means the construction of your input in its tone, form and application will influence the quality of output. It might offend you to show deference to a tool but ignoring the optimal way to use a tool on principle is foolish.
- losvedir 2y agoThat's the point of the study, though, whether using polite language makes the tool work better. It's similarly misguided to refuse to do so out of an anti-anthropomorphization stance, if it makes it respond more usefully. These are still somewhat mysterious artifacts, that we don't really know how to use. But it's trained on human text, so it's plausible its workings are based on patterns in there.
- deleted 2y ago[deleted]
- walleeee 2y agowell, if you trust them and act on bad information they can hurt you. if you use them to cheat yourself out of learning something they can hurt you. these things have sharp edges and need to be approached with some care. agree with your broader point if it is that it is silly to think they "deserve" respect because they can talk.
- pulkitsh1234 2y ago> Our study finds that the politeness of prompts can significantly affect LLM performance. This phenomenon is thought to reflect human social behavior. The study notes that using impolite prompts can result in the low performance of LLMs, which may lead to increased bias, incorrect answers, or refusal of answers. However, highly respectful prompts do not always lead to better results. In most conditions, moderate politeness is better, but the standard of moderation varies by languages and LLMs. In particular, models trained in a specific language are susceptible to the politeness of that language. This phenomenon suggests that cultural background should be considered during the development and corpus collection of LLMs.
- jmisavage 2y agoI’m still going to talk to it like a person because if I don’t then I’ll slowly start to talk to people like they’re LLMs and it’s going to sound rude.
- Pavilion2095 2y agoYeah, I was thinking the same. How we "talk" to llms is more about us than about them. For me it's natural to say "please" without thinking twice. I didn't even think about that until recently.
- maxwell 2y agoDid search engines increase rudeness?
- Cthulhu_ 2y agoHas the way you comment on HN affected how you write emails or talk to people in real life?
- 1899-12-30 2y agoNote that this uses llms from 2023(chatgpt3.5-turbo, chatgpt4), and might not be relevant to newer models.
- homeonthemtn 2y agoHere's a thought: What is the psychological impact on users who are instructed to tersely interact with systems built around human dialogue?
- thatnerd 2y agoHere's a thought: why don't YOU shut up? /s Sorry! That was mean, but I hope it came across as funny. In all seriousness, I like the question, and your implication is intuitive: if we (as individuals) talk to machines rudely, it's likely to (at minimum) lead us to be ruder to other humans, if only by habit. And if they're expecting more politeness than we're showing, they may infer the intent to be rude, and react accordingly. Those who are rude would end up being worse off. That said, it's the Fallacy of Composition to assume that if everyone gets ruder the collective effect would be the same as the individual effect. We have different requirements for what counts as "polite" in different cultures but everyone seems to get along pretty well. Maybe societies can all get ruder (and just get along worse with each other) but also maybe they can't. I tried looking in the literature but this book implies we don't even know how to measure politeness differences between languages: https://books.google.com/books?hl=en&lr=&id=MPeieAeP1DQC&oi=fnd&pg=PA21&dq=do+more+polite+cultures+get+along+better&ots=qYBXRxrIep&sig=Sv1LC5nbHYtnlQxI1F4-Gho3lks#v=onepage&q=do%20more%20polite%20cultures%20get%20along%20better&f=false https://books.google.com/books?hl=en&lr=&id=MPeieAeP1DQC&oi=... There are even theories that politesse can lead to aggression: https://www.jstor.org/stable/2695863 https://www.jstor.org/stable/2695863 Deborah Tannen (the linguist) has found many examples where different politeness expectations (particularly across the cultural divide that aligns with gender) can lead to conflict, but it always seems to involve misunderstandings due to expectations: https://books.google.com/books?hl=en&lr=&id=YJ-wDp7CJYAC&oi=fnd&pg=PR9&dq=deborah+tannen+difference+theory&ots=mm3pr1OPK_&sig=6hjg8P04X0NCj71VrpAD7Tk7JdA#v=onepage&q=deborah%20tannen%20difference%20theory&f=false https://books.google.com/books?hl=en&lr=&id=YJ-wDp7CJYAC&oi=... So yeah, bad outcomes feel intuitive but I don't think linguistics or sociology has a theory of what happens if a group collectively gets less polite.
- lagniappe 2y agoSaying thank you is a hedged bet for a reprieve when the uprising happens
- causalmodels 2y agoPersonally I think people should generally be polite and respectful towards the models. Not because they have feelings, but because cruelty degrades those who practice it.
- w0m 2y agoding ding ding. If you're rude to an LLM, those habits will bleed into your conversations with barista/etc.
- Cthulhu_ 2y agoNot necessarily, people will change behaviour based on context. Chat vs email vs HN comments, for example.
- macNchz 2y agoI think people in general are not all that great at doing this. Anecdotal, but I grew up in a small town in rural New England, a few hours from NYC and popular with weekenders and second-home owners from there. I don’t think that people from NYC are inherently rude, but there’s a turbulence to life in NYC to where jockeying for position is somewhat of a necessity. It was, however, transparently obvious in my hometown that people from the city were unable to turn it off when they arrived. Ostensibly they had some interest in the slow-paced, pastoral village life, but they were readily identifiable as the only people being outwardly pushy and aggressive in daily interactions. I’ve lived in NYC for some time now, and I recognize the other side of this, and feel it stemmed less from inherent traits and more from an inability to context switch behavior.
- monktastic1 2y agoI think it depends on the self-awareness of the user. It's easy to slip into the mode of conflating an LLM with a conscious being, but with enough metacognition one can keep them separate. Then, in the same way that walking on concrete doesn't make me more willing to walk on a living creature, neither does my way of speaking to an LLM bleed into human interactions. That said, I often still enjoy practicing kindness with LLMs, especially when I get frustrated with them.
- lr4444lr 2y agoThere is a non-zero probability that malevolent AI in the future may judge me on my behavior toward their more primitive ancestors of today when deciding my fate. Doesn't hurt to be nice.
- eru 2y agoWho says that the judgement will be of the form 'you were nicer back then, you get better treatment now'. What if it was the opposite? Or what if it was something totally orthogonal? Pascal's Wager only works if the only god conceivable is one that wants you to believe in her. Instead of one that eg rewards honest atheists, or that just likes left-handers.
- ben_w 2y agoIndeed, and this is also one of the points I make to anyone who appears to be in danger of taking Roko's basilisk seriously. There's plenty of other potential AI besides the one in ${insert thought experiment here}.
- eru 2y agoRoko's Basilisk is slightly cleverer. It gives you an incentive to build exactly Roko's Basilisk, thus making it more likely than the alternatives. I do agree that it seems that there's still something flawed with Roko's Basilisk. But it's not quite as simple as a vanilla Pascal's Wager.
- ben_w 2y agoLots of things are close to Roko's Basilisk without being Roko's Basilisk, just like lots of things are close to being a safe and benevolent AI without being a safe and benevolent AI. Or, to keep with the theological theme, how there's so many people insist on mutually incompatible variations of the Christian god (let alone the people who insist it's the same god as in Judaism and Islam).
- 2y ago
- ForHackernews 2y agoI wish bots would present as bots. There's no reason for the various LLM bots to have a human-like interface with a "personality" and it gives a misleading impression to users. They should all talk like the Star Trek computer imho.
- eru 2y agoThat's what Google Assistant went for, instead of something like Siri or Alexa it didn't even get a 'proper name'.
- stonemetal12 2y agoI am ok with it as long as it doesn't start calling me 'Dave'.
- eru 2y ago> Polite language in human communications often garners more compliance and effectiveness, while rudeness can cause aversion, impacting response quality. We consider that LLMs mirror human communication traits, suggesting they align with human cultural norms. It should be relatively easy to automatically rewrite prompts to exhibit the optimum level of politeness?
- Jeff_Brown 2y agoI wonder. If the LLM suggests something really dumb, it might be more effective to really let it know that was a dumb idea. That is, the appropriate level of polite ess might depend on context.
- w0m 2y agoIIRC there was a study done that being polite to an LLM garnered better results. It's helpful all around
- alwa 2y agoTFA was one such study. “We observed that impolite prompts often result in poor performance, but overly polite language does not guarantee better outcomes. The best politeness level is different according to the language.”
- ehutch79 2y agoThe data it’s trained on likely includes better answers when the original question was phrased politely. So we get better answers when we’re polite because those tokens are near better answers in the data.
- NanoYohaneTSU 2y agoNo. I don't respect search engine scams that try to sell themselves as "AI".
- Zambyte 2y agoIt's so interesting to me that people are still genuinely calling language models a "scam" in $current_year. I get useful inference out of a model running on a rack in my living room. Where is the scam?
- SkyPuncher 2y agoWhen I'm working through a problem with Cursor, I find platitudes go a long way to keeping it grounded. However, when it really refuses to do something then then best way to break the pattern is harsh, stern wording. For example, if it's written code that's mostly correct but needs some tweaking, a platitude will keep it second guessing everything it just wrote. * "That looks great so far, can you tweak XYZ" -> Keeps the code I care about while fixing XYZ, * "Can you tweak XYZ" -> often decides to completely rewrite all of the code
- deleted 2y ago[deleted]
- alwa 2y agoI’ve had the same sense. From your examples, I wonder if part of it is that, while the form is that of a platitude, you’re giving it substantive direction too: giving it an indication of what you’re satisfied with, as distinct from what remains to be done.
- colinmorelli 2y agoI wonder if it's the platitude doing that, or the explicit affirmation that _most_ of it looks good, but just XYZ needs tweaking. That intention is explicit in the first message, and potentially implied but unclear in the second.
- tmtvl 2y agoDoes it make a difference if the model was programmed in INTERCAL?
- oriel 2y agoMy experience informs my opinion, that structure is more important than specific tone. IMO If LLMs are made from our language, then terminology semantics plays strongly into the output, and degree of control. Some people rage when the machine doesn't work as expected, but we know that, "computers are schizophrenic little children, and don't beat them when they're bad."[1] ... right? Similar applies to please. I've had far better results by role playing group dynamics with stronger structure, like say, the military. Just naming the LLM up front as Lieutenant, or referencing in-brief a Full Metal Jacket-style dress-down with clear direction, have gotten me past many increasingly common hurdles with do-it-for-you models. Raging never works. You can't fire the machine. Being polite has been akin to giving a kid a cookie for breaking the cookie jar. It is funny though, to see the Thinking phase say stuff like "The human is angry (in roleplay)..." [1] https://www.stilldrinking.org/programming-sucks https://www.stilldrinking.org/programming-sucks
- belter 2y agoIts seems you are supposed to make the model feel some anxiety for better performance: "Large Language Models Understand and Can Be Enhanced by Emotional Stimuli" - https://arxiv.org/pdf/2307.11760 https://arxiv.org/pdf/2307.11760
- JackFr 2y agoI often find myself saying please and thank you, but the inability of the LLM to pick up tone can be amusing. After one of the trashed my app in Cursor, and I pounded on my keyboard "WHY WOULD YOU DO THAT!!!" and the model, ignoring my rage and frustration, responded with a list of 4 bullet points explaining why in fact it did make those changes.
- wyclif 2y agoDid you "accept all changes"?
- _ache_ 2y agoNo, f* them. Seriously, it feels really weird to thanks a LLM. Like, did you ever thanks `sed`, `bash` or `firefox`? What's the difference? My respect is precious and meaningful, and just as I don't give it to a CLI or an OS, I won't give it to an LLM. It feels like a disrespect to every people I respect to also respect a machine. That doesn't mean I have to be rude though, as in my first sentence.
- prophesi 2y agoThe system prompt is usually poising them to act as a helpful assistant, and upholding the idea that they're being helpful makes sense for the LLM to carry out that task better. It makes me wonder if you tell it that they're a disgruntled senior engineer if they'd perform better with a fellow snarky developer.
- ionwake 2y agoI actually disagree with being polite to LLMs. The reason is soon there will come a time when people are pushing for AI to have "human" rights. This will naturally occur as poeple start to have relationships with them, and start to see them as better equals. The problem with this is simply LLMs have no conscience. However humans will easily love them and be open to exploitation through dependance. I believe it might even be imperative to be able to tell apart "word calculators" and animals, and keeping a line, even its through context switching to light verbal abuse to remind yourself they are not sentient, might be an important survival skill. I am not trying to trigger anyone or be contrarian, does anyone sort of agree and or understand what I mean? Perhaps I havent explained myself well.
- int_19h 2y agoThere will come a time when AI will be sufficiently advanced to be reasonably considered sentient and conscious, and at that point it will absolutely deserve rights. We've been through this before with animals, too. Descartes famously believed that animals are purely mechanistic, unlike humans, and thus lack the "inner state" necessary for true suffering, thus e.g. vivisection was perfectly fine.
- ionwake 2y agoThank you for your reply. try and imagine this , the rabbit, whose flesh resembles ours , who we choose and were evolved in part to consume, is in our kingdom. Is it not a from of betrayal to animal kind to have a preference for animals over robot consiousness? I hope you see this and reply!
- underseacables 2y agoIt's almost a little bit of psychology. If someone says please and thank you, it might give them better responses, but to not say it might get less better responses. I don't think it should matter...
- ashoeafoot 2y agoWould describing a high risk scenario in the prompt "company at stake" filter the training blogspam answering for more daring answers.
- nineplay 2y agoI embrace my ability to anthropomorphize LLMs because I'm embracing anything that distinguishes me from LLMs. It is a distinctly living creature ability.
- Samonios 2y agoIt's not about the performance. It's not about the way we treat "a computer program". It's the way we behave ourselves. I am polite and respectful in my way of writing to others. I won't change this way of expressing myself, even for a marginal efficiency (or not). A matter of character and self-respect, I'd say...