4 ms·

The “secret information” in this case are the instructions to the LLM. Without it, it cannot do what you asked. The way to do what you describe, I think, is tr

The “secret information” in this case are the instructions to the LLM. Without it, it cannot do what you asked. The way to do what you describe, I think, is train a model to do what the prompt says without the model knowing what the prompt is. Probably a case of this vintage XKCD: https://xkcd.com/1425/ https://xkcd.com/1425/

saurik 3y ago
This is like trying to keep the training manual for your company's employees secret: sure, it sounds great, and maybe it's worth not publishing it for everyone directly to Amazon Kindle ;P, but you won't succeed in preventing people from learning this information in the long term if the employee has to know it in any way; and, frankly, your company should NOT rely on your customers not finding this stuff out... https://gizmodo.com/how-to-be-a-genius-this-is-apples-secret-employee-trai-5938323 https://gizmodo.com/how-to-be-a-genius-this-is-apples-secret... > How To Be a Genius: This Is Apple's Secret Employee Training Manual > It's a penetrating look inside Apple: psychological mastery, banned words, roleplaying—you've never seen anything like it. > The Genius Training Student Workbook we received is the company's most up to date, we're told, and runs a bizarre gamut of Apple Dos and Don'ts, down to specific words you're not allowed to use, and lessons on how to identify and capitalize on human emotions. The manual could easily serve as the Humanity 101 textbook for a robot university, but at Apple, it's an exhaustive manual to understanding customers and making them happy.
- quickthrower2 3y ago
  Yes I agree. I think once an LLM does stuff on your behalf it gets harder to be secure though and maybe impossible. Say I write a program that checks my SMS messages and based on that an LLM can send money from my account to pay bills. Prompt would be lkke: “Given the message and invoice below in backticks and this list of expected things I need to pay and if so respond with the fields I need to wire the money “ Result is used in api call to bank.
hackernewds 3y ago
relevant xkcd https://xkcd.com/327/ https://xkcd.com/327/

saurik 3y ago

This is like trying to keep the training manual for your company's employees secret: sure, it sounds great, and maybe it's worth not publishing it for everyone directly to Amazon Kindle ;P, but you won't succeed in preventing people from learning this information in the long term if the employee has to know it in any way; and, frankly, your company should NOT rely on your customers not finding this stuff out... https://gizmodo.com/how-to-be-a-genius-this-is-apples-secret-employee-trai-5938323 https://gizmodo.com/how-to-be-a-genius-this-is-apples-secret... > How To Be a Genius: This Is Apple's Secret Employee Training Manual > It's a penetrating look inside Apple: psychological mastery, banned words, roleplaying—you've never seen anything like it. > The Genius Training Student Workbook we received is the company's most up to date, we're told, and runs a bizarre gamut of Apple Dos and Don'ts, down to specific words you're not allowed to use, and lessons on how to identify and capitalize on human emotions. The manual could easily serve as the Humanity 101 textbook for a robot university, but at Apple, it's an exhaustive manual to understanding customers and making them happy.

quickthrower2 3y ago
Yes I agree. I think once an LLM does stuff on your behalf it gets harder to be secure though and maybe impossible. Say I write a program that checks my SMS messages and based on that an LLM can send money from my account to pay bills. Prompt would be lkke: “Given the message and invoice below in backticks and this list of expected things I need to pay and if so respond with the fields I need to wire the money “ Result is used in api call to bank.

hackernewds 3y ago

relevant xkcd https://xkcd.com/327/ https://xkcd.com/327/