4 ms·
Memories are implemented differently agent to agent. They are usually implemented by yet-another-model-call, as a distillation of typed prompts (working memory)
by Supermancho 2mo ago
Memories are implemented differently agent to agent. They are usually implemented by yet-another-model-call, as a distillation of typed prompts (working memory). Conversational communication is messy with a lower signal to noise ratio than the distillation (semantic memory). Semantic memories are much better than appending raw historical prompts.
Skills are prompts, albeit in a specific format. This is apparent in say, Codex where $MYSKILL is literally injecting the skill-prompt inline into a typed prompt. This all gets passed into the semantic memory system anyways, refining away cruft like redundancy, pleasantries, et al.
- epolanski 2mo agoAnd none of this works properly. None. You have to remind it what's in it's own memory, or the subagent skill is influenced by the main system prompt. It's sloppy vibe coders productivity porn.
- Supermancho 2mo agoRe: Memories and Skills > And none of this works properly. None. `Properly` is an ambiguous term. It may mean "not what someone expects" or something else, but I think this assertion is factually incorrect. > You have to remind it what's in it's own memory, Almost every agent pushes out prompt/context-prompts from the context window (overloaded naming, fun), rather than treating the existing context-prompt hierarchy as an immutable part of the window. Regardless, looking at agent code, it works as designed. > the subagent skill is influenced by the main system prompt. This is implied and working as intended. The skill is an additive prompt. Prompts are part of a hierarchy. System, Agent, User, Input (skill and typed) which all influence each other. Why it's over-engineered with a format rather than a flat text file, is beyond me. LLMs are virtually deterministic for small questions. They don't scale linearly or consistently. That's a mismatch of expectations, rather than a fatal flaw. The utility is a matter of risk management.