4 ms·
If you used better prompts you could use a less expensive model. "return nothing if you find nothing" is the level 0 version of giving the LLM an out. Give it
by CuriouslyC 3y ago
If you used better prompts you could use a less expensive model.
"return nothing if you find nothing" is the level 0 version of giving the LLM an out. Give it a softer out ("in the event that you do not have sufficient information to make conclusive statements, you may hypothesize as long as you state clearly that you are doing so, and note the evidence and logical basis for your hypothesis") then ask it to evaluate its own response at the end.
- codewithcheese 3y agoYeah also prompts should not be developed in abstract. Goal of a prompt is to activate the models internal respentations for it to best achieve the task. Without automated methods, this requires iteratively testing the models reaction to different input and trying to understand how it's interpreting the request and where it's falling down and then patching up those holes. Need to verify if it even knows what you mean by nothing.
- jsemrau 3y agoIn the end, it comes down to a task similar to people management where giving clear and simple instructions is the best.
- azinman2 3y agoWhich automated method do you use?
- CuriouslyC 3y agoThe only public prompt optimizer that I'm aware of now is DSPy, but it doesn't optimize your main prompt request, just some of the problem solving strategies the LLM is instructed to use, and your few shot learning examples. I wouldn't be surprised if there's a public general prompt optimizing agent by this time next year though.
- deleted 3y ago[deleted]