5 ms·
You could try out Prompta [1], which I made for this use case. Initially created to use OpenAI as a desktop app, but can use any compatible API including Ollama
by iansinnott 3y ago
You could try out Prompta [1], which I made for this use case. Initially created to use OpenAI as a desktop app, but can use any compatible API including Ollama if you want local completions.
[1]: https://github.com/iansinnott/prompta https://github.com/iansinnott/prompta
- CGamesPlay 3y agoThis one doesn't seem to support system prompts, which are absolutely essential for getting useful output from LLMs.
- derwiki 3y agoCan you speak more to this? I get useful output from LLMs all the time, but never use system prompts. What am I missing?
- CGamesPlay 3y agoSure, I use one system prompt template to make ChatGPT be more concise. Compare these two: https://sharegpt.com/c/fEZKMIy https://sharegpt.com/c/fEZKMIy vs https://sharegpt.com/c/S2lyYON https://sharegpt.com/c/S2lyYON I use similar ones to get ChatGPT to be more thorough or diligent as well. From my limited experience with local models, this type of system prompting is even more important than with ChatGPT 4.
- addandsubtract 3y agoIs there a difference in using a system prompt and just pasting the "system prompt" part at the beginning of your message?
- CGamesPlay 3y agoHaven't tested, but having it built-in is more convenient, and convenience is why I'm using these tools in the first place (as a replacement for StackOverflow, for example).
- iansinnott 3y agoYou can update the system prompt in the settings. Admittedly this is not mentioned in the README, but is customizable.
- refulgentis 3y ago> the system prompt There isn't a singular system prompt. It really does matter! Copy the OpenAI playground, you'll thank yourself later
- 8n4vidtmkvmk 3y agoYou use multiple system prompts in a single chat? What for?
- iansinnott 3y agoFair point, and it's not implemented that way currently. It's more like "custom instructions" but thanks for pointing that out. I haven't used multiple system prompts in the OpenAI playground either, so I hadn't given it much thought.
- a_bonobo 3y agoI've run into the same problem with deploying Gemini locally, it does not seem to support System Prompts. I've cheated around this by auto-prepending the system prompt to the user prompt, and then deleting it from the user-displayed prompt again.