16 ms·
Finally doing something standards-compliant instead of forcing users into a proprietary workflow.
by askonomm 15d ago
Finally doing something standards-compliant instead of forcing users into a proprietary workflow.
- klodolph 15d agoCLAUDE.md: @AGENTS.md
- swyx 15d agofwiw, i am with thariq https://x.com/trq212/status/2092302273099796842 https://x.com/trq212/status/2092302273099796842 in that prompts should be tuned for models and in fact blindly applying agents.md is probably an antipattern unless you want all models to basically converge to some common ill defined of instruction following - good local minima, bad global minima for model diversity and exploration of intelligence. aka, sometimes it really is too early to force a standard
- arcanemachiner 15d agoNo thanks, I'm not tuning a bunch of files just for things to break when I switch models or a new one comes out. I'll just use my one-size-fits-all AGENTS.md file and tweak it when the one of the clankers screw up. I don't have time for such busywork. Actually, I will append extra rules to CLAUDE.md (which imports AGENTS.md) since there is a hook there, and Claude has its own foibles. So I'll backpedal a bit there.
- atonse 15d agoYeah but are models good enough to review these files and say “i would work better if you worded it this way?”
- willsmith72 15d agodepends what you're doing. if you've got a specialized agent deployed in prod, of course your evals and prompts will be targeted towards 1 specific version of a model. on the other hand if it's just a local coding/"use my computer" agent, i highly doubt the effort in maintaining different prompts is worth any gain in performance
- groby_b 15d agoThat's of course rather nonsensical. In a "one LLM only" environment, your instructions are by default tuned for said LLM. In a multi-LLM environment, roughly nobody will keep separate sets of instructions for each. It's not a realistic take. On top of that: If your LLM is so bad at reading that it can't follow a set of instructions that wasn't specifically written just for that one single precious LLM, I sure wonder what that says about your employers repeated statements that ASI is definitely right around the corner.
- TomGarden 15d agoBy this logic you'd probably be wise to tier your claude.md by model (sonnet/opus) as well as effort level too, considering the varying failure modes
- swyx 15d agoexcept they have similar pretrain/rlhf data which is the thing u really want to tune for
- llm_nerd 15d agoI'm honestly not sure if this is tongue in cheek and the "finally" is in the silly way it is often used, but the claude.md variant existed first. Indeed, the agents.md thing was pretty clearly a "that's neat, let's do that with a different name".
- bredren 15d agoThere’s also that whole MCP thing.
- verdverm 15d agoIt's "finally" because people have been asking for it for a long time. No one cares that "claude was first," what they want is for Ant to follow the conventions and not put extra work on us. This was such a minimal thing to do, and considering how much they vibe and claim "coding is solved," we thought it would not be too difficult to respect AGENTS.md, so finally seeing it happen, while nice, is too late for me. I've moved on from Big Ai and only use open weight models now.
- askonomm 15d agoJust because something is first, doesn't mean it's the standard. The standard is put in place by how many harnesses use a specific pattern, and that has been AGENTS.md for a long while now. Long enough that Claude Code not supporting it is really just an act of forcing people into a proprietary workflow, because of course it's in their interest to make moving away as painful as possible given how little moat the LLM models themselves have. In fact, I think Claude Code has been pretty much the only one not supporting AGENTS.md. Check out https://agents.md https://agents.md if you want more information on it.
- mahboi 15d agoTrying to make a .md file proprietary by changing the name is hilarious
- jwolfe 15d agoclaude.md predates agents.md.
- anon373839 15d agoThe world has moved on.
- mahboi 15d agoYeah but .md predates claude.md. I had agent.md files in my repo before Claude tried to act like it's a special protocol.
- slashdave 15d agoStandards? In LLM harnesses? I wish