3 ms·

The most annoying thing I've found is that they always assume I'm right. If I ask a question, they assume the answer is yes, and will bend over backwards in an

The most annoying thing I've found is that they always assume I'm right. If I ask a question, they assume the answer is yes, and will bend over backwards in an obsequious manner to ensure that I'm correct. "Why of course, sir, we should absolutely be trying to compile python to assembly in order to run our tests. Why didn't I think of that? I'll redesign our testing strategy immediately."

j_bum 2y ago
Ugh , I agree. I would imagine this all comes from fine tuning, or RLHF, whatever is used. I’d bet LLMs trained on the internet without the final “tweaking” steps would roast most of my questions … which is exactly what I want when I’m wrong without realizing it.
mulmboy 2y ago
Yeah I get this. Often I'll prompt it like "my intern looked at this and said maybe you should x. What do you think?" Seems to help.
- bredren 2y ago
  h/t to @knurlknurl on Reddit today shared these methods: - “I need you to be my red team”(works really well with, Claude seems to understand the term) “analyze the plan and highlight any weaknesses, counter arguments and blind spots critically review” > you can't just say "disagree with me", you have to prompt it into adding a "counter check".
duxup 2y ago
It’s funny AI will happily follow my lead and “bounce too close to a supernova” and I really have to push it to offer something new.
enraged_camel 2y ago
>> The most annoying thing I've found is that they always assume I'm right. Not always. The other day I described the architecture of a file upload feature I have on my website. I then told Claude that I want to change it. The response stunned me: it said "actually, the current architecture is the most common method, and it has these strengths over the other [also well-known] method you're describing..." The question I asked it wasn't "explain the pros and cons of each approach" or even "should I change it". I had more or less made my decision and was just providing Claude with context. I really didn't expect a "what you have is the better way" type of answer.
hnbad 2y ago
Similarly, with Claude in Cursor I've found that it will assume it's wrong when I even suggest that it might be: "Are you sure that's right? I've not seen that method before" will be followed by "I need to apologize, let me correct myself" and a wrong answer and this'll loop until eventually arriving at a worse version of what it suggested first even if I tell it "Nevermind, you were right in the first place. Let's go with that one".

j_bum 2y ago

Ugh , I agree. I would imagine this all comes from fine tuning, or RLHF, whatever is used. I’d bet LLMs trained on the internet without the final “tweaking” steps would roast most of my questions … which is exactly what I want when I’m wrong without realizing it.

mulmboy 2y ago

Yeah I get this. Often I'll prompt it like "my intern looked at this and said maybe you should x. What do you think?" Seems to help.

bredren 2y ago
h/t to @knurlknurl on Reddit today shared these methods: - “I need you to be my red team”(works really well with, Claude seems to understand the term) “analyze the plan and highlight any weaknesses, counter arguments and blind spots critically review” > you can't just say "disagree with me", you have to prompt it into adding a "counter check".

duxup 2y ago

It’s funny AI will happily follow my lead and “bounce too close to a supernova” and I really have to push it to offer something new.

enraged_camel 2y ago

>> The most annoying thing I've found is that they always assume I'm right. Not always. The other day I described the architecture of a file upload feature I have on my website. I then told Claude that I want to change it. The response stunned me: it said "actually, the current architecture is the most common method, and it has these strengths over the other [also well-known] method you're describing..." The question I asked it wasn't "explain the pros and cons of each approach" or even "should I change it". I had more or less made my decision and was just providing Claude with context. I really didn't expect a "what you have is the better way" type of answer.

hnbad 2y ago

Similarly, with Claude in Cursor I've found that it will assume it's wrong when I even suggest that it might be: "Are you sure that's right? I've not seen that method before" will be followed by "I need to apologize, let me correct myself" and a wrong answer and this'll loop until eventually arriving at a worse version of what it suggested first even if I tell it "Nevermind, you were right in the first place. Let's go with that one".