3 ms·
Those are remarkably longer than I would expect, or think is warranted. The leading vendors have been saying recently that you should give the models shorter an
by SwellJoe 2mo ago
Those are remarkably longer than I would expect, or think is warranted. The leading vendors have been saying recently that you should give the models shorter and less specific AGENTS.md (or whatever) files, and in my experience, that's good advice. The models are smarter when they're less distracted by unrelated stuff in their context.
So, why so much noise in the system prompt? Most of the time most of it will not apply. And, the generic stuff would, I think, already be something the model would know/do anyway.
I've noticed agent skills written by models make the same mistakes; e.g. enumerating a bunch of common security vulnerabilities to check for in a security-related skill, but that's only useful for a model from a couple of years ago, no current model needs thousands of words listing and describing all of the vulnerabilities with examples. Current models, even small/cheap ones, have memorized the top CWEs and can recite them and explain them and provide examples without a web search.
It feels like a CYA document. Which, I guess a company of their size and influence has to do. But, it still feels like waste time say lot word when few word do trick.
- y1zhou 2mo agoMaybe these longer system prompts are part of the reason why we can give the models shorter AGENTS.md files? A lot of what people commonly write in their *.md instructions may be already covered.
- Yokohiii 2mo agoWhat about the obvious? They put everything in the system prompt what wasn't economic enough to solve in a different way or just forgot / messed up.
- bertan 2mo agoAgreed. That’s why I use pi as my harness when I use Claude models through an API. Models are capable without these huge system prompts and I am not wasting context or attention. The only issue is I can’t use a subscription without Claude Code.