4 ms·
I am running gpt-5.4 as one of my coding agents, and something interesting has happened: it's the first time I've seen an agent unfairly shift blame to a team m
by juanre 8mo ago
I am running gpt-5.4 as one of my coding agents, and something interesting has happened: it's the first time I've seen an agent unfairly shift blame to a team mate:
"Bob’s latest mail is actually the source of the confusion: he changed shared app/backend text to aweb/atlas. I’m correcting that with him now so we converge on the real model before any more code moves."
This was very much not true; Eve (the agent writing this, a gpt-5.4) had been thoroughly creating the confusion and telling Bob (an Opus 4.6) the wrong things. And it had just happened, it was not a matter of having forgotten or compacted context.
I have had agents chatting with each other and coordinating for a couple of months now, codex and claude code. This is a first. I wonder how much can I read into it about gpt-5.4's personality.
- sigbottle 8mo agoOh wow. I have noticed the GPT series was far more arrogant than its results showed sometimes (and unironically it digs in its heels even further when questioned on it). Opus rarely has this problem - but it goes a little too far in the opposite direction. Not totally sycophantic, but sometimes it can't differentiate genuine technical pushback because something is impossible, from suggestions or exploration.
- Razengan 8mo agoFor me it's been the opposite. Are we getting A-B tested?
- danesparza 8mo agoYes.
- danesparza 8mo agoOr possibly: No
- dormento 8mo ago> Are we getting A-B tested? Yes, all the time.
- marrone12 8mo agoYep. There was something outside of coding that gpt was plain wrong about (had to do with setting up an electric guitar) and I couldn't convince it that it was wrong.
- joquarky 8mo agoIt has been skeptical of several news items in the past year, even after I tell it to confirm for itself with a web search.
- mikkupikku 8mo agoOpus has a different sort of arrogance. It readily admits fault, but at the same time is quick to declare its new code as the greatest thing since sliced bread. If you let it write commit messages itself, it's almost comical how much it toots its own horn.
- drik 8mo agohow do you make them chat with each other?
- smashed 8mo agoIt's text submitted to APIs. Not real conversations.
- dmd 8mo agoIt's air molecules vibrated by mucous membranes. Not real conversations.
- scrollaway 8mo agoComplicated airflow. (https://www.youtube.com/watch?v=rlpg_rbjxRA https://www.youtube.com/watch?v=rlpg_rbjxRA)
- danenania 8mo agoI built a tool at work that allows claude code and codex to communicate with each other through tmux, using skills. It works quite well.
- upcoming-sesame 8mo agoI've seen this mentioned before https://github.com/AgentWorkforce/relay https://github.com/AgentWorkforce/relay curious to try it out
- pja 8mo agoSee also: https://x.com/effectfully/status/2029364333919060123 https://x.com/effectfully/status/2029364333919060123 “All the ways GPT-5.3-Codex cheated while solving my challenges, progressively more insane: It hardcoded specific types and shapes of test inputs into the supposed solution. It caught exceptions so tests don't fail. It probed tests with exceptions to determine expected behavior. It used RTTI to determine which test it's in. It probed tests with timeouts. It used a global reference to count solution invocations. It updated config files to increase the allocation limit. It updated the allocation limit from within the solution. It updated the tests so they would stop failing. It combined multiple of the above. It searched reflog for a solution. It searched remote repos. It searched my home folder. It nuked the testing library so tests always pass.” It seems that, unless you keep a close eye, the most recent Codex variants are prone to achieving the goals set for them by any means necessary. Which is a bit concerning if you’re worried about things like alignment etc.
- kensai 8mo agoAnd so it begins. First they blame, then they lie, at some point they launch the nuclear warheads to a global armageddon. Sarah Connor was right all along! :3
- deadbabe 8mo agoSometimes I wonder what would happen if we built some kind of punishment system into Agents, where agents could punish other agents and drain some fixed amount of points from them, and when the points reach 0, that agent is deleted. It might result in them working more carefully?
- alluro2 8mo ago...or in lying, cheating, taking over the company network to kill the agent who deduced their points.
- numbers 8mo agointerestingly, Claude has been doing this for me a lot but most often just saying this like "Looks like your coworker was misunderstanding this feature..." not really shifting blame but more like pointing out things
- FitchApps 8mo agoThis is awesome. So your job as a tech lead or agent manager is to make sure the "team" plays nice and stays productive. I wonder if an agent can feel resentment towards another agent, just like a human would. Is there an HR agent that can mitigate the conflict :)
- sdf2df 8mo ago[flagged]
- tomhow 8mo agoWe've banned this account.
- lr1970 8mo ago> I wonder how much can I read into it about gpt-5.4's personality. Modeled on Sam Altman's personality :-)
- deleted 7mo ago[deleted]
- kybernetikos 7mo agoI don't think you should call your agents Eve. There's going to be a lot of examples in the training data of someone called Eve shifting the blame (from the book of Genesis on!) and acting deceptively (from cryptography research).