Disclosure: I'm generally pessimistic about LLMs, so the subtext was: "It's best to assume it'll leak eventually, so have a plan for that." Anywho, delaying th

Disclosure: I'm generally pessimistic about LLMs, so the subtext was: "It's best to assume it'll leak eventually, so have a plan for that." Anywho, delaying that moment means a remote service under your own control, and some code which checks all output for prompt exfiltration attacks (which may not be plaintext, but base64 and weirder things) while also minimizing false-positives or legitimate use cases, like a code-method they can use with an implementation you want to keep secret.