3 ms·

In theory, yes. Consider the case where the prompt includes considerable amoounts of (proprietary) source code.

• Terr_ 2y ago
  Disclosure: I'm generally pessimistic about LLMs, so the subtext was: "It's best to assume it'll leak eventually, so have a plan for that." Anywho, delaying that moment means a remote service under your own control, and some code which checks all output for prompt exfiltration attacks (which may not be plaintext, but base64 and weirder things) while also minimizing false-positives or legitimate use cases, like a code-method they can use with an implementation you want to keep secret.