3 ms·
Pretty much every single detailed prompt made after trial, error, and refinement is tailored to a specific LLM. They will all perform worse used with other LLMs
by sgc 5mo ago
Pretty much every single detailed prompt made after trial, error, and refinement is tailored to a specific LLM. They will all perform worse used with other LLMs than a similar prompt tailored for the second LLM would perform, and at times quite poorly.
- tvmalsv 5mo agoHow well would it work to ask the working LLM to rewrite the prompt to get the best results? Do the models understand enough about themselves to do that?
- sgc 5mo agoClaude has a /product-self-knowledge skill, and I am sure the others have something similar. So yes, it is possible if you work with care, as necessary with all things LLM related. There are hundreds if not thousands of skills on github that were created just this way.
- CamperBob2 5mo agoThat's kind of pointless, then, because what happens when Anthropic releases their next-gen model?
- sgc 5mo agoIt's not like you aim to do it, you are just in a feedback loop improving results for the tool you are using. It is inherent in any prompt developed through iteration.