4 ms·
You should look at the consumer app system prompt: https://twitter.com/amandaaskell/status/1765207842993434880 https://twitter.com/amandaaskell/status/176520784
by BoorishBears 3y ago
You should look at the consumer app system prompt: https://twitter.com/amandaaskell/status/1765207842993434880 https://twitter.com/amandaaskell/status/1765207842993434880
I've had way more success taking it and forming it to my tasks than stuffing in a bunch of tokens about how to do things.
In one case I was able to go from ~6k in input tokens to ~3k because I no longer had to provide a mountain of examples and instructions for corner cases
- namanyayg 3y agoCan you elaborate on how does the claude system prompt help in creating prompts for different tasks?
- BoorishBears 3y agoAnytime I see a prompt from one of these companies, I assume it matches the style of instructions the model encountered during pre-training. And the kinds of instruction formats that were encountered during pre-training end up informing what style of instruction the model is best at following. An extreme example would be prompt templates that a "raw" instruct-tuned LLM follows: the model will technically work with a suboptimal format, but you get much better performance if you follow the prompt template the model was trained/fine-tuned on. - It's not a guarantee a given prompting style was involved during pre-training of course, but at the very least it's going to a provide a jumping off point that the creators of the model co-signed on.