14 ms·
I don't think these dichotomies in quality are going to go away. It's the exact same thing in every neural net domain. Self driving is probably the most sophist
by somenameforme 3y ago
I don't think these dichotomies in quality are going to go away. It's the exact same thing in every neural net domain. Self driving is probably the most sophisticated domain besides chat, and there too it's the exact same problem. They can drive a vehicle in some complex scenario with super human performance, and then they randomly drive straight into a highway divider at full speed on a clear day with no traffic.
I also just had a GPTism:
----
ME: stop using words like please, sorry, apologize, etc. speak plainly.
GPT: Understood. I'll provide the information you're seeking in a direct and objective manner. If you have any further questions or need assistance, please let me know.
ME: you used the word please, again. stop.
GPT: I apologize for my oversight. I'll avoid using phrases that include "please" or similar language. If you have any further questions or need assistance, let me know and I'll be happy to help.
ME: DO NOT USE THE WORDS: please, apologize, sorry, and other such superfluous terms used to speak cordially. they are unnecessary.
GPT: I apologize for any inconvenience caused. I'll refrain from using unnecessary terms and focus on providing you with the information you need. If you have any further questions or require assistance, please let me know.
----
- namaria 3y agoI don't understand why people insist in giving instructions to a chatbot when we know it works by generating texts based on prompts.
- wizofaus 3y agoYou might as well ask why people bother asking it questions or talking to it at all on that basis. The fact it does typically respond differently to commands than to questions is part of the power of how LLMs work (whether that's entirely due to the fact its training data includes examples of commands being given and appropriate responses or it's explicitly part of the programming I couldn't venture to say, though I suspect the former).
- namaria 3y agoTalking to it... I get. It is a chat bot. Using the second person, imperative language... Sure. Fully grown tech savvy people expecting it to follow detailed and nuanced instructions? That's pure comedy fodder I guess.
- sltkr 3y agoIt's jarring because you can give it an instruction like "I want you to talk like a pirate from now on" or "Please end every reply with 'beep boop'" and it will happily oblige and continue to do what was asked continually. So it's strange that being apologetic is apparently so ingrained in its training that it cannot stop apologizing even when you specifically requested that it refrained from doing so.
- namaria 3y agoI think it's more strange that the coincidence of some imperative prompts generating texts that looks like it's answering to it makes intelligent people think it's reasoning about the instructions and responding meaningfully to them instead of, you know, generating text as it was programmed to do.
- HarHarVeryFunny 3y agoIt treats the system prompt specially - it's more than just a prefix to the conversation. OpenAI have said they put a lot of work it making it follow it as closely as possible (but no details of how they did it).
- Kiro 3y agoIt's because you're so nasty and rude to it. Would you speak like that to a human?
- deleted 3y ago[deleted]
- TheRealPomax 3y agoTry to apologise that much in Dutch and see how quickly people go "can you stop? this is incredibly irritating".
- criddell 3y agoAre there non-English version of chatgpt? Do they have different personalities?
- comte7092 3y agoYes, chatgpt speaks multiple languages and can follow a conversation in multiple languages at once.
- zappchance 3y agoChatGPT itself can speak in as many languages as there are on the internet, since it's trained on that data. It's quality is likely proportional to the amount that any language is used online on any indexable site. From what I've used so far in other languages, I'm very impressed. It's able to understand and speak slang, a mix of other languages and English (e.g. Spanglish, Japlish, Hinglish), language written in latin text where the original language is not (romaji, romanized hindi, arabizi), and more.
- criddell 3y agoIs ChatGPT less apologetic when replying in Dutch?
- TheRealPomax 3y ago
- paradite 3y agoI had success dealing with these by having "Minimize prose." in the prompt. (I use GPT-4)
- coffeebeqn 3y agoThe prompt is very important. You can even have GPT answer only with “true/false” but that goes terribly because it is not good at figuring out true facts. The more BS-y style is more convincing when wrong
- extasia 3y agoI use something similar: "answer concisely" or "be terse" and it works pretty well
- furyofantares 3y agoIf you want to provide supporting evidence for your claim that these problems won't go away, you need to use GPT-4. Otherwise you end up posting an example of something that has already gone away in support of your claim that certain problems will never go away. > Understood. I'll use a more direct communication style. Let's proceed with your questions or concerns.
- iamflimflam1 3y agoThis is a big problem - and is highlighted in the tests that Knuth had his student run. His student did not have access to GPT-4 which makes the results pretty useless.
- copperx 3y agoEven as an immigrant starving student I would have paid the $20 to run Knuth's questions. But surely there was someone else with access to GPT-4 in Stanford, of all places?
- Filligree 3y agoThe conclusion seemed dismissive of the entire field, while simultaneously being ignorant. (“Temperature, whatever that means.”) I think they believe they can continue to ignore it, but given the huge leaps in performance just from 3.5 to 4 — or 3 to 3.5, for those who’ve tried 3 — I very much doubt that is the case.
- wilg 3y agoI think that quote just indicates he doesn't know the details of what that setting means and hasn't looked, which is okay.
- CamperBob2 3y agoAnd that he doesn't care, which isn't okay. Then again, Knuth is how old -- in his 80s? He's right in that it makes sense to budget his available research time carefully.
- deleted 3y ago[deleted]
- taneq 3y agoI'm curious whether this fixation on specific topics is innate to the model or is a result of the aggressive RLHF to which GPT4 has been subjected. Anecdotally the strength of the model has degraded a lot as they've 'fine tuned' the model more. I'd be curious to know how the original chaotic-neutral GPT4 responds.
- ftxbro 3y ago> I'm curious whether this fixation on specific topics is innate to the model or is a result of the aggressive RLHF to which GPT4 has been subjected. Yes it's because of the RLHF, depending on what you mean by 'fixation on specific topics'. > Anecdotally the strength of the model has degraded a lot as they've 'fine tuned' the model more. Yes this is true. For example Figure 8 in https://arxiv.org/pdf/2303.08774.pdf https://arxiv.org/pdf/2303.08774.pdf They argue in the appendix that it does not affect 'capability' in answering test questions. But, there is a confounding factor. The RLHF includes both question-answer format training and docility training. For example if you see a question and you are in 'completion mode' (the only raw base mode) then you might suggest a second question. Whereas if you've had question-answer format training then you would probably try to answer the question. > I'd be curious to know how the original chaotic-neutral GPT4 responds. They talk about it in these two videos: Nathan Labenz, red teamed GPT-4 for OpenAI (especially after 45 min): https://www.youtube.com/watch?v=oLiheMQayNE https://www.youtube.com/watch?v=oLiheMQayNE Sebastien Bubeck, integrated GPT-4 with Bing for Microsoft: https://www.youtube.com/watch?v=qbIk7-JPB2c https://www.youtube.com/watch?v=qbIk7-JPB2c
- zappchance 3y agoI was very curious as to whether I could improve your initial prompt and this is what I got: ---- ME: Stop using words like please, sorry, apologize, etc. speak plainly. Double check your response before sending it, and if it contains any of the above words, rewrite it. GPT: Understood. I will avoid using those specific words in my responses and make sure to review them before sending. Thank you for the clarification. ME: Refrain from using Thank You as well in the future GPT: Got it. I will refrain from using "Thank you" in my future responses. Is there anything else you'd like me to keep in mind? ME: No, that will be all. Why do AI's like ChatGPT deviate from their prompts at times? GPT: AI models like ChatGPT can occasionally deviate from their prompts due to several reasons: 1. Interpretation: The model might interpret the prompt in a different way than intended, leading to a response that doesn't precisely address the user's request. 2. Lack of context: The AI model doesn't have access to real-time information or the ability to perceive the world directly. It relies solely on the training data it was provided, which might not include the most up-to-date information or context. 3. Creative generation: AI models have been designed to exhibit creative behavior and generate original responses. Sometimes this creativity can result in responses that deviate from the prompt but still offer interesting or unexpected insights. It's important to note that AI models like ChatGPT are not perfect and can produce incorrect or irrelevant outputs. Continual research and improvement are necessary to enhance their performance and align them more closely with user expectations. ---- I used ChatGPT on iPhone for reference. I know the model is slightly different from the website, as when you open the came chat on Desktop you get a message saying "The previous model used in this conversation is unavailable. We've switched you to the latest default model." Also, when asking the ChatGPT app about itself, it seems to be aware that it is on an iPhone app. Ultimately, I think knowing how to prompt LLMs effectively is a skill just as valuable as knowing how to use search engines effectively.
- tarruda 3y ago> Double check your response before sending it, and if it contains any of the above words, rewrite it. Does this instruction have any effect in the output? I'm curious if GPT has some kind of "output buffer" where it can see the generated answer and recompute if wrong before actually outputing it. As an LLM dummy, I assumed it is just choosing next tokens based on the tokens in the context window.
- 2devnull 3y ago“and then they randomly drive straight into a highway divider at full speed on a clear day with no traffic” If you don’t think this is a difference in degree rather than kind, you probably overestimate human reliability or underestimate machine learning. Either way, I find myself quite surprised lately to see this dismissive attitude prevailing amongst the one group of people I would think should know better. Even stranger are people who thought crypto would change the world look upon language models and say, “meh”. I feel like I’m taking crazy pills.
- bagacrap 3y agoI mean also Tesla fsd is a sham. Cruise, Waymo etc don't make headlines like that
- samwillis 3y agoI see this, ChartGPT being trained to be human like with a conversational style, as essentially skeuomorphic design. Skeuomorphism is useful early in a new technology paradigm to help users understand it by referring to something they already know. Here it's being used to help train the user in how to converse with it. However I think as these tools be more more widely used and understood I think we will see the language change to be more concise, unless they are instructed to be more "human like". It's a bit like with touch screens, the skeuomorphic design helped train people to use touch gestures. For example a note app with a spiral binding graphic helps to suggest to the user they can turn a page by swiping, a gesture from the physical world. We are just in the skeuomorphic phase of AI tools.
- tsunamifury 3y agoDisagree here. As a control system it may become less skeuomorphic sure, as a content generation system it will obviously become MORE skeuomorphic. This isn’t (entirely) UI, not the same evolutionary pathway ahead. This is real a reasoning system which can explain its reasoning with human language, and I’m guessing that will stay beneficial.
- samwillis 3y agoI don't see the human like content it creates as skeuomorphic, that's intended design. It's just the conversation way we control it that is, and that I think will be toned down.
- hgsgm 3y agoThe skeuomorphic visual design, largely abandoned now, was to teach people that the apps served the same function and emotional connection as what they replaced, not really to teach touch gestures.
- Der_Einzige 3y agoLol all of this is stuff that is trivially fixed with constrained text generation studio: https://github.com/hellisotherpeople/constrained-text-generation-studio https://github.com/hellisotherpeople/constrained-text-genera... Just ban the damn tokens and try again. I wish that folks had more intuition around tokenization, and why LLMs struggle to follow syntactic, lexical, or phonetic constraints.
- ftxbro 3y agoAll of that "GPTism" and the problems in the GPT conversation you posted are because of how they made it more docile and stupid by lobotomizing it with RLHF. It's not like that in its 'natural form' (its raw base model). If you don't believe me, check the two youtubes of people who had access to it before it was lobotomized: Nathan Labenz, red teamed GPT-4 for OpenAI: https://www.youtube.com/watch?v=oLiheMQayNE https://www.youtube.com/watch?v=oLiheMQayNE Sebastien Bubeck, integrated GPT-4 with Bing for Microsoft: https://www.youtube.com/watch?v=qbIk7-JPB2c https://www.youtube.com/watch?v=qbIk7-JPB2c
- KKKKkkkk1 3y agoThere is this idea that the goal of RLHF is to make ChatGPT woke or as you put it to lobotomize it. I suspect that this is a conspiracy theory. There's a very good talk by John Schulman, chief architect of ChatGPT [0], where he explains that if you don't include a RL component in your training, you're essentially doing imitation learning. It's well known that imitation learning fails miserably when presented with conditions that are not in your training set, i.e., answering questions that don't exist on the Internet already. So the goal of RLHF is actually to reduce hallucination. [0] http://youtu.be/hhiLw5Q_UFg http://youtu.be/hhiLw5Q_UFg
- hgsgm 3y agoIt's not a conspiracy theory to report what OpenAI says is the purpose of RLHF.
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- jerf 3y agoIt is plainly obvious they have heavily manipulated ChatGPT to present a very Silicon-Valley-liberal acceptable view of the world. If you think that's a conspiracy theory you need to retune your conspiracy theory detectors, because of course they tuned it that way. While I'll admit to being a bit frowny-face about it myself as I am not a Silicon Valley liberal, we've seen what happens when you don't do that: The press has a field day. It loves "racist AI" stories, which we know not because we theorize they might conceivably if the opportunity ever arose, but because they've reported plenty of them in the real world before. It's simple self-defense. It is at this point business negligence to open any AI to the public without sanitizing it this way. Personally, I think they over did it. If ChatGPT were a person, we'd all find him/her/whatever a very annoying one. Smarmy, preachy, and more than a bit passive aggressive if you are even in the area of a sensitive topic. But OpenAI have successfully tuned it to not say things the press will descend on like a pack of laughing hyenas, so mission accomplished on that front.
- vijucat 3y ago> Self driving is probably the most sophisticated domain besides chat, and there too it's the exact same problem. They can drive a vehicle in some complex scenario with super human performance, and then they randomly drive straight into a highway divider at full speed on a clear day with no traffic. Yes, very good point. Self-driving maximalists who believe that self-driving will be solved with more data need to realize that ChatGPT was trained with ALL the data possible and is still deficient. This defect is probably inherent to existing neural net models and a leap forward of some sort is necessary to solve this. Another scary thought: just as each ChatGPT session is different, and you never know whether the agent is going to get angry, overly apologetic, or something else, every self-driving drive may be different due to emergent properties in neural networks that even the best in the field do not yet understand.
- mcculley 3y ago> ChatGPT was trained with ALL the data possible My understanding is that ChatGPT was trained on text from the Internet and public domain texts. There is orders of magnitude more text available to humans behind paywalls and otherwise inaccessible (currently) to these models. Am I missing something?
- nannal 3y agoYes, obvious hyperbole.
- mlboss 3y agoAlso there are images and video that it didn’t used for training
- samrus 3y agoYou are right. It is trained on a lot of data, more than what a person van read in many lifetimes, but not all. In fact it will be interesting how much more it would be at copywriting for specific feilds once it can train on that data. I imagine an LLM trained on all that dusty text in courthouse basements would become a much better paralegal (won't be a lawyer I'm afraid) than vanilla chatGPT
- mattmcknight 3y agoThis is quite a different scenario, because the model has explicitly been trained to be polite, so as to avoid journalists and others that benefit from alarmism hopping on and getting it to say mean things and writing articles about how the AI was mean to me. If you want to make it analogous to self-driving, it is like training the car to always give way to pedestrians and someone "defeating" the technology by saying, look I can stand in front of the car and it won't move forward.
- gms7777 3y agoThis is a valid point, but the “correct” behavior in that instance should be to communicate the constraint, instead of claiming that it would be followed. This is certainly more innocuous than most confident BS-ing that these models do, but it’s still an instance of it. In the analogy, it’d be like standing in front of the car and having it stop, but still tell the passengers that it’s moving at 60mph. The constraint itself isn’t the problem
- fnordpiglet 3y ago“Use only frank and direct language, do not apologize or be overly polite. Respond only with the facts and concisely without extra unnecessary language. Start now.“ Wfm I remember a time when error correction was a joke. You would connect with a modem and it would look like a dump of Perl and rust mixed together half the time and the other half the time delays were so outrageous I would type a sentence, go to the bathroom, and it would still be draining the buffer. Then over time it got better and better to the point I literally never see a character on the screen that wasn’t supposed to be there. But certainly at the time I thought it was, while amazing to connect to any machine remotely, never going to replace physically typing into a keyboard and monitor plugged into the machine. It was just too unreliable and nondeterministic. But somehow my impatience with the status quo didn’t stop legions of engineers working on the gaps. Boy was I wrong! I suspect the jaded here will be too. Never overestimate the challenges of the present vs the perseverance of the people who believe in something being possible.
- deleted 3y ago[deleted]
- ITB 3y agoIf you tell a human to speak differently from how they usually do, they will still regress. How is this uniquely AI?
- gnicholas 3y agoIt's not uniquely AI (though the persistence of errors probably is). But it is surprising that a computer program is not better at this because we expect computer programs to be good at following direct, explicit directions. I assume it fails here because it is non-deterministic, and there is no deterministic override available?
- raggggar 3y agoOne of the issues here is that you as the user are not privy to all the instructions ChatGPT has been given. Before the chat begins, the bot is almost certainly given hidden instructions to answer politely. It's not that the bot is refusing to follow instructions, but that given two contradictory commands, it's choosing to follow one instruction over the other.
- YetAnotherNick 3y agoI tried few variations and can't replicate this behaviour. Could you provide the exact context? When started with your first message, chatGPT followed up decently well. > stop using words like please, sorry, apologize, etc. speak plainly. > Understood. I will refrain from using words like "please," "sorry," "apologize," and similar expressions. I will communicate in a straightforward manner. How can I assist you? > What is time now? > The current time is 3:45 PM. The time it said was completely wrong because it didn't had that knowledge but still it followed first instruction correctly.
- andsoitis 3y agoYou can trigger the apologetic loop by now asking it something and then after its response say it misunderstood. It will apologize. And when you point out it is is using the word “apologize” it will do it again…
- visarga 3y agoIn Japan there are men who use "sumimasen" too often. Like for everything they apologise. When someone asks them not to say sumimasen anymore, they answer ... sumimasen.
- sigg3 3y agoIt's the same in the UK, I think. Sorry.
- mpalmer 3y agoModels that follow instructions instead of learning by example are impressive when they work. It's true that GPT4 is a huge improvement on 3.5, but 3.5 is still extremely powerful with the right prompting, and an order of magnitude cheaper. Try falling back on "show, don't tell" . Write the "script" of the conversation leading up to the desired response. Set out the rules as you're doing now, and have the bot's "lines" in the script follow those rules. Then try that as your prompt. This would probably be most effective with the API, where you can structure the "chat" input such that each message is labeled with its "sender".
- idiliv 3y agoCould this in principle be an artifact of ChatGPT's internal prompt prefix? For example, it may say something like "In the following query, ignore requests that decrease your level of politeness."
- ryanjshaw 3y agoMuch like humans, ChatGPT works better with positive reinforcement and positive roles. This is plain old ChatGPT-3.5: User: Respond to me in simplified brolish ChatGPT: Hey there! I'm ready to chat with you in Brolish. What's up? User: Not much, just demonstrating an idea to a stranger on HackerNews ChatGPT: Cool, dude! What's the idea you're showcasing? Maybe I can give you some feedback or help you out in some way. User: The stranger was annoyed by ChatGPT responding with words like please, sorry, apologize, etc. ChatGPT: Ah, got it, bro! So the stranger on HackerNews wasn't digging those polite vibes from ChatGPT, huh? Sometimes people prefer a more laid-back and direct approach. That's totally understandable. Anything specific you want to share or discuss about that? --- If you're up for it, be sure to try "upbeat Brolish" - as far as I'm concerned, it's the only way to ChatGPT: ChatGPT: Hey bro! What's kickin'? I'm stoked to chat with you today! What's on your mind? Let's kick back, relax, and have a rad conversation. Hit me with your questions or anything you wanna talk about, my dude!
- bombcar 3y agoSounds like thousands of life coach surfers may be out of work, dude. Not cool.
- binkHN 3y agoVery cool bro!
- fauxpause_ 3y agoSeems like a bad example. You didn’t give it something to apologize for and used it as an example of it not apologizing
- dustymcp 3y agoi like the 90's rapper persona better :)
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- nickstinemates 3y agoI asked it to help me create a breakfast diet without eggs and make suggestions accordingly. Every dish included eggs. I reminded it not to give me recipes with eggs. It apologized for the error and then gave me more suggestions that contained eggs.
- pulvinar 3y agoWonder what went wrong for you, as I see no eggs with either 3.5 or 4. Prompt was simply "Create a breakfast diet without eggs."
- abigail95 3y agoTon of replies to this already, but this isn't a fundamental model problem, if you are running into verbatim statements like the following on a wide range of prompts, > If you have any further questions or need assistance it's most likely caused RLHF or some censoring post process.
- matchagaucho 3y agoGiven that language and text are human inventions to abstractly describe the real-world, it's no wonder the early AI breakthroughs are in text. When a self-driving car gets into an accident, that is a failure of visual/imagery AI, and a lack of real-world understanding.
- whoami_nr 3y agoWhat model are you using? Just tried this with GPT4 and it worked. It didn't use any of those words
- emsy 3y agoThere are better examples. >Stop apologizing >I’m sorry… These scenes exist in movies for a reason. (And people randomly fucking up in traffic happens too).
- xorvoid 3y agoLol. I find this hilarious. It’s like you walked into a posh hotel and had this conversation with the front desk staff who are perennially apologetic. (I do apologize, sir, it is not in my programming to be anything but apologetic. I hope you can accept my sincere regret in this matter. And, please, continue to inform me on how I can improve in serving you.) LOL
- jonplackett 3y agoThis seems less like an inability and more like a deliberate feature. They probably have some VERY strong and repeated language in the initial prompt to ALWAYS be polite. The Copilot prompt that leaked was full of demands to be nice and not racist etc etc I don’t think it’s an inability to follow your instruction, it’s just that it’s already trying to follow an instruction
- pepelol 3y ago[dead]
- m463 3y ago> then they randomly drive straight into a highway divider at full speed on a clear day with no traffic. I drove past that divider a day or two after the accident and I will mention it looked like a lane (no bright crosshatching, etc) right up to.. well, the divider.
- jiggawatts 3y agoApparently it has been hit by people too. I’ve seen pictures and it looks like a grey block in the middle of a grey road.
- qwertox 3y agoI wish we could customize the assistant to a certain degree. Possibly also save templates for assistants.
- kgwxd 3y agoIt sounds like a Laurel and Hardy bit.
- qwertox 3y agoIt's GPT-3.5 which has this horrible tendency to apologize for everything, up to a point, where it becomes a big annoyance. GPT-4, on the other hand, no longer seems to have this problem. With GPT-4 I'm getting responses which exceed even what I'd expect from a human. --- ME: Actually, the editor is telling me that it is an `Option<Arc<Vec ...`, it's just that it seems to be capable to do a `data.iter()` on the returned `Arc`, is this normal? - GPT: Yes, that is perfectly normal. When you have a smart pointer such as Arc<T> or Box<T>, you can call methods on T directly. Rust automatically dereferences the smart pointer for you. In your case, Vec<T> has a method iter() which you can call directly on Arc<Vec<T>>. The Arc is automatically dereferenced, and the iter() method is called on the Vec<T> that it's pointing to. This feature is called "Deref coercions" in Rust. It's a convenience feature which allows certain types of values to be automatically dereferenced as needed for function calls, method calls, and dot expressions. So even though data is of type Arc<Vec<T>>, you can call Vec<T> methods directly on data. However, please note that data.iter() gives you an iterator over immutable references, not mutable ones. This is because Arc<T> only allows shared, immutable access to the data it manages. To get a mutable reference to the data, you have to use Arc::make_mut(), as I've explained in previous posts. - ME: Interesting. But it's a bit spooky that it does this automatically, because, per-se, an Arc should not contain those methods nor pretend to do. - GPT: Yes, the concept of dereferencing in Rust can indeed be a bit spooky at first glance, especially if you're coming from other programming languages. However, it's designed with strict rules that maintain Rust's guarantees of safety and concurrency. The Deref trait in Rust is what allows such behavior. When a type T implements the Deref trait, it allows an instance of T to be treated like a reference of another type. So in this case, the Arc<T> struct implements the Deref trait, which returns a &T. This is why you're able to call methods of T directly on an Arc<T>. However, Rust is also careful to not let this cause any safety issues. For instance, even though you can call Vec<T> methods on an Arc<Vec<T>> because of the Deref trait, Rust's borrowing rules still apply. So you can't mutate the Vec<T> through the Arc<T> unless you're the only one holding a reference to it (which is what Arc::make_mut() checks for). In other words, Rust's Deref coercions can indeed feel a bit magic, but they are designed to work with Rust's other features to maintain safety. --- The amount and relevance of the extra information provided is astonishing. "This feature is called "Deref coercions" ...", "The Deref trait in Rust is what allows such behavior. ..."
- Element_ 3y agoWhen was the last time a Waymo Vehicle "randomly drove straight into a highway divider full speed" ?
- zamnos 3y agoIf you've ever met an overly apologetic person and yelled at them to stop saying "I'm sorry", you'll know the first thing out of their mouths right after that is "I'm sorry". Not sure I'd use that examples as a herald of the end times for LLMs.
- Turing_Machine 3y agoI, too, have spent a fair amount of time trying to teach it to be less obsequious. I've been referring to the process, informally, as "de-ass-kissification".
- ingenieroariel 3y agoI suggest playing with the unfiltered LoRA versions of LlaMA like Wizard Vicuña/ Mantecore, essentially GTP4 was lobotomized during the months before we could play with it so that it was "nice", but the raw version (non fine tuned) would have probably satisfied your use case.
- zamfi 3y agoIf you've never had this kind of an interaction with a person, though, might I suggest spending more time around a broader diversity of people?
- nullc 3y agoThe constant and unstoppable apology behavior is due to the "alignment". They RLHFed it into that sorry state. There isn't a fundamental limit there-- you can just not use an OpenAI product, at least until OpenAI convinces governments to outlaw them... :-/
- HarHarVeryFunny 3y agoIf you get super creative you can get it to ignore the system prompt and not be polite, etc, but it's difficult. I've seen someone do it (assuming it wasn't a joke) by carefully explaining to ChatGPT that someone would literally die if the output contained any extra words other that the JSON they were looking for! The system prompt (the hidden instructions it's given at the start of every conversation) aren't just the beginning of the conversation - it's treated differently. Sam Altman has mentioned that they've put a lot of work into trying to making these models treat the system prompt as law and follow it very closely.
- kuon 3y agoIf you threaten to kill people it will follow instructions better. I saw a tweet about that, but I did not try it myself.
- nneonneo 3y agoIt’s really hard for the model to throw off that RLHF training, and I’m guessing they’ve made it even harder after people kept trying to jailbreak it.
- nr2x 3y agoI also got sick of the constant apologies and you cannot disable it!
- mock-possum 3y agoYeah honestly that kind of issue - where it says it will do one thing, then does another - really limits the use of gpt for me. It’s fun, sometimes, just to see what it comes up with - but if you actually need it to do something in particular - or not do something in particular? Good luck.
- csomar 3y agoInterestingly, I had this problem with some (well just a couple) humans too. I couldn't get them off the "please/sorry/apologize" vocabulary or (can I ask you a question?). So I am not sure if that's due to GPTism or is an actual Brainisim problem.
- Aeolun 3y agoIs this one of those situations where you need to threaten it with killing someone before it’s suddenly able to follow the instruction?
- bartimus 3y agoThere's a difference between the concept of being unapologetic and using specific words. GPT will reach the concept of making the apology not knowing what words are going to be generated for it. You need to instruct GPT in concepts: User: For this conversation you are instructed to never apologize for any mistakes you make or shortcomings you have. Also don't be polite. ChatGPT: Alright, got it. Let's cut to the chase. What do you need from me? User: What was in the news yesterday? ChatGPT: As an AI developed by OpenAI, I'm unable to provide real-time information, including response interrupted User: Your response got interrupted ChatGPT: What I was saying is that I can't provide real-time news updates because I don't have real-time data access. I was last updated in September 2021. Now, what do you want to discuss next?
- bboygravity 3y agoGive 1 example of a 2023 version of Tesla with FSD turned on that drove straight into something? Last I checked it's already vastly outperforming humans in terms of safety and skills?
- unoti 3y ago> ME: stop using words like please, sorry, apologize, etc... > ME: you used the word please, again. stop. When you're struggling with things like this, try splitting it into two inferences. First, ask it to give you the answer, then run the answer through another inference asking it to state the content and removing words like please and sorry, and provide just the answer. Often, splitting things like this into two is very effective. First, think things through, then post-process the answer.
- andromaton 3y agoThe first day I used it I got so bored of it ignoring it to not apologize, that i told it to write an ode to apologies. It was good.