3 ms·
Supposedly "Be concise" in a prompt can save 40% on API costs. I wonder how effective attacks against API cost would be. I suspect it would be very easy to get
by danpalmer 3y ago
Supposedly "Be concise" in a prompt can save 40% on API costs. I wonder how effective attacks against API cost would be. I suspect it would be very easy to get ChatGPT to output as much text as the API or quota will allow.
It feels like what I imagine the early internet was, where you could stick `'; drop table users;` into email fields and ruin someone's day. There's so much scope for security issues as LLMs are woven into services, exposed through cracks to users.
Everywhere that could be SQL/database injected, or shell injected, can now be LLM injected. The difference being that where databases/shells are intended to work with a strict character set and have separation of data and command channels, LLMs don't currently have that separation and are designed to use unstructured data so ensuring they aren't being attacked cannot be known in the general case.
I suspect that over time LLM use will fall into two categories: sandboxed LLMs where users can interact directly for creative purposes, and LLMs that untrusted users do not get direct access to, where user input is narrowly specified, and sanitised by a sandboxed LLM.
- singularity2001 3y agoI wish there was a "default prompt" so that I don't have to add "think step by step, be concise" every single time
- danpalmer 3y agoThere is a default prompt built into every one of these systems. If it doesn't contain those instructions it's probably for good reason. ChatGPT seems to target a more creative output, for which I could imagine "think step by step, be concise" is not appropriate.
- Turing_Machine 3y agoI don't think the OP is arguing for a system-wide default prompt, but rather the ability to add his own default prompt. I think that would be quite useful. Something like "add 'think step by step, be concise' to all my prompts, unless I include '/noboilerplate' in the prompt". Same for other systems. I recently generated dozens of images with Midjourney, which I wanted to all be in the same style. It sure would have been nice to tell it "add [artistic movement] illustration in the style of [artist]" to every prompt", without typing it in manually every time.