4 ms·
> If the Model makes repeated mistakes on the same subject matter, you can update your agent.md file ... That's all just prompting. > How do you think models
by rowanG077 3mo ago
> If the Model makes repeated mistakes on the same subject matter, you can update your agent.md file ...
That's all just prompting.
> How do you think models are created? They are trained on feedback and learn.
No one is post training models on a single mistake. At least I have not seen it. I also doubt it is effective. Post-training on a single failure will not meaningfully change the model. That even sidesteps the entire problem that you don't even have access to models if you use a provider like anthropic/openai
- brookst 3mo ago> That's all just prompting And telling someone not to repeat a mistake is… ?
- rowanG077 3mo agoAre you really making the case that teaching a person how to work is equivalent to prompting an AI?
- brookst 3mo agoYes. Tell me why it’s different without using circular reasoning?
- rowanG077 3mo agoThey're different mechanisms. Teaching modifies the learner. Prompting doesn't modify the model. It provides additional context that influences a single inference. A person who has learned something can apply it years later without being reminded. An LLM generally cannot unless the knowledge is incorporated into the model itself or provided again.
- SR2Z 3mo agoRight, but "provided again" is what SKILL.md or whatever else are for. The value of LLMs is that they're stateless. With sufficiently detailed documentation and a well-bounded task, they are quite useful.
- rowanG077 3mo agoI don't think it's generally thought of an advantage that LLMs are stateless. In deployment it's nice, it would be much better if the model could continually learn. I'm not claiming LLMs are not useful, they most certainly are.
- unparagoned 3mo agoA human requires sleep the update their mental model to use that learning years later. Take a human and prevent them from sleeping after covering a fact then years later they won’t know it.
- rowanG077 3mo agosleeping helps learning, but people can learn without sleep. You can teach something to a person and they can usually do it immediately in some capacity. If you prevent a person from sleeping they will have reduced capacity to remember things. But it will most certainly not be zero.
- throw1234567891 3mo ago> That's all just prompting. >> Joe, how many times have I asked you to pay attention to commas. Come on, "let's eat grandma".