2 ms·

> Because the AI-agents we use with direct code-access aren't very chatty. Every time I tell claude code something it did is wrong, or might be wrong, or even

> Because the AI-agents we use with direct code-access aren't very chatty. Every time I tell claude code something it did is wrong, or might be wrong, or even just ask a leading question about a potential bug it just wrote, it leads with "You're absolutely correct!" before even invoking any tools. Maybe you've just become used to ignoring this. I mostly ignore it but it is a bit annoying when I'm trying to use the agent to help me figure out if the code it wrote is correct, so I ask it some question it should be capable of helping with and it leads with "you're absolutely correct". I didn't make a proposition that can be correct or not, and it didn't do any work yet to to investigate my question - it feels like it has poisoned its own context by leading with this.

devjab 1y ago
It may have to do with workflow. I rarely talk with the AI agent, I task it with a VIBE.md or a specific outlined prompt that relates to inline "COPILOT: ...." comments, and then I review the changes and either keep or dismiss them. When I dismiss them I'll mostly rewrite the promt and do it again in a new context window. I did get curious though. So I decided to look up some of the times where I did correct it after I dismissed a change. I only looked at a couple of prompts but most of the AI responses looked like this: "There are two issues...", "The error is because...", "The error persists because...", "A new route, /class_ids/fully_owned, has been added...". I was feeling confident that it wasn't bullshitting me at that point, but then I get to this one: "Thank you for the details. The error response..." Now, that is the AI agent. If I use the browser or one of their "apps" the LLM politeness encouragement bullshit alone will often be longer than the entire chat response in an agent. Like this is the entire response to what it was tasked with in my example: "To add this route, I'll implement a new endpoint that queries all unique class_id values and checks if all items with that class_id have is_owned == True. The route will return a list of such class_id values. I'll add this as a new GET route, e.g., /class_ids/fully_owned." ChatGPT (which is supposedly the same model) will spend those lines telling me what a great question it was.
steveklabnik 1y ago
I put some stuff in Claude.md to tell it to chill out, and that helps. If you want it to communicate with you in a given style, tell it to do that.

devjab 1y ago

It may have to do with workflow. I rarely talk with the AI agent, I task it with a VIBE.md or a specific outlined prompt that relates to inline "COPILOT: ...." comments, and then I review the changes and either keep or dismiss them. When I dismiss them I'll mostly rewrite the promt and do it again in a new context window. I did get curious though. So I decided to look up some of the times where I did correct it after I dismissed a change. I only looked at a couple of prompts but most of the AI responses looked like this: "There are two issues...", "The error is because...", "The error persists because...", "A new route, /class_ids/fully_owned, has been added...". I was feeling confident that it wasn't bullshitting me at that point, but then I get to this one: "Thank you for the details. The error response..." Now, that is the AI agent. If I use the browser or one of their "apps" the LLM politeness encouragement bullshit alone will often be longer than the entire chat response in an agent. Like this is the entire response to what it was tasked with in my example: "To add this route, I'll implement a new endpoint that queries all unique class_id values and checks if all items with that class_id have is_owned == True. The route will return a list of such class_id values. I'll add this as a new GET route, e.g., /class_ids/fully_owned." ChatGPT (which is supposedly the same model) will spend those lines telling me what a great question it was.

steveklabnik 1y ago

I put some stuff in Claude.md to tell it to chill out, and that helps. If you want it to communicate with you in a given style, tell it to do that.