3 ms·
It shouldn't be surprising that if you know the answer to a question you can use prompt engineering to manipulate the model into producing the answer you're loo
by chongli 4y ago
It shouldn't be surprising that if you know the answer to a question you can use prompt engineering to manipulate the model into producing the answer you're looking for.
Now put yourself into the shoes of a person who does not know the answer, such as a person learning English as a second language who is unfamiliar with this use of "I'm afraid", asking a direct question:
Prompt:
My boss said he was afraid he was going to have to let me go. Why is he afraid?
Response (chat-gpt.org):
As an AI language model, I cannot know for sure what your boss is thinking, but it is possible that he may be afraid to let you go because he values your work and does not want to lose a valuable employee. It could also be that he is afraid of the impact it will have on your work, your colleagues, or even his own performance as a manager. Another possibility is that he is simply using the word "afraid" as a way to express concern or apprehension. It's best to have a conversation with your boss and ask him to clarify his statement to better understand his reasoning.
So the model does produce the correct response, that "afraid" is used to express apprehension, but it is buried beneath some meaningless platitudes that are very likely to be wrong. If your boss is letting you go, he does not value your work enough to continue paying you. An English language learner hoping to understand the boss's phrasing is not going to be helped by the suggestion "just prompt engineer the model into cloning the behaviour of an Ivy League English lit professor."
Edit: It's also rather amusing that the model suggests that the boss is "afraid of the impact it will have on your work". Letting an employee go tends to have a rather severe, some might say terminal, impact on their work!
- daveguy 4y agoThis misses the most likely interpretation. That "I'm afraid" is an empathetic (or pseudo-empathetic) substitute for "I'm sorry, but..." implying that you have been fired and it doesn't matter the impact on your work. The boss isn't literally afraid and you are fired.
- quickthrower2 4y agoYes it is a cliche/trope/idiom. Surely the embeddings etc. can “get that” about the word “afraid”. But what is really missing is the empathy for the question. The question implies ESL and it didn’t get that. But honestly would the average HN replier get it? You probably need chatgpt to ask more clarifying questions.
- hooo 4y agoIt's probably from the whole AI safety thing where they try to not have it offend anyone.
- ianbutler 4y agoI don't know I got it to explain the ambiguity pretty well. You just have to ask it to: Prompt: My boss said he was afraid he was going to have to let me go. Why is he afraid? Explain multiple meanings. Answer: When your boss said he was "afraid" he was going to have to let you go, it can be interpreted in a few different ways. Here are some possible meanings behind his statement: Expression of regret: In this context, "afraid" could be used as a polite way of expressing regret or disappointment. Your boss might feel bad about the situation and is using the term to soften the impact of the news. It can be seen as a more gentle way of saying that he has no other choice but to let you go. Anticipation of negative consequences: Your boss might be genuinely concerned about the potential fallout from letting you go. This could include the impact on team morale, the workload for remaining employees, or the possibility of a negative reaction from you. In this sense, "afraid" reflects his apprehension about the consequences of the decision. Uncertainty about the decision: Your boss could be feeling uncertain about the decision to let you go and might be using "afraid" to express his hesitancy. He could be unsure whether this is the right move for the company or whether it is fair to you, which could make him feel anxious. Empathy for your situation: "Afraid" could also indicate that your boss is putting himself in your shoes and understanding how difficult the situation must be for you. He might be fearful of the impact that losing your job will have on your personal life, finances, or future career prospects. It's important to consider the context and tone in which your boss made this statement to better understand his intended meaning. To gain more clarity, you may want to discuss the situation further with your boss and ask for more information about the reasons behind the decision. ------------- That isn't a particularly massaged prompt either, I just asked for multiple meanings.