3 ms·

This reads like a highschooler going "hey, hey did you know? You can, okay don't tell anyone, you can just look up books on military arms in the library!! Black

This reads like a highschooler going "hey, hey did you know? You can, okay don't tell anyone, you can just look up books on military arms in the library!! Black hat life hack O_O!!!". What is the point of this? Getting an LLM to give you information you can already trivially find if you, I don't know, don't use an LLM and just search the web? Sure, you're "tricking the LLM" but you're wasting time and effort on tricking an LLM into making it tell you something you could have just looked up already.

Retr0id 2y ago
"LLM security" is more about making sure corporate chatbots don't say things that would embarrass their owners if screenshotted and posted on social media.
- yieldcrv 2y ago
  I think we should just address what is “embarrassing” then Twenty years ago I was in a group of old technology thought leaders who spent the meeting worried about people playing computer games as a character with a different gender as their own They wanted to find a way to prevent that, especially in an online setting To them, this would be embarrassing for the individual, for society, and for any corporation involved or intermediary But in reality this was the most absurd thing to even consider as a problem, it was always completely benign, was already commonplace, and nobody ever removed ad dollars or shareholder support or grants because of this reality The same will be true this “LLM security” field
  - plaguuuuuu 2y ago
    It's not quite the same. "LLM security" is not security for the users, it's security for OpenAI etc against lawsuits or government enacting AI safety laws.
    - yieldcrv 2y ago
      the similarity being that it will remain a waste of time
  - wredcoll 2y ago
    > Twenty years ago I was in a group of old technology thought leaders who spent the meeting worried about people playing computer games as a character with a different gender as their own Please, tell me more. I want, I need, all the details. This sounds hilarious.
- blincoln 2y ago
  It gets more interesting when someone gives the LLM the power to trigger actions outside of the chat, the LLM has access to genuinely sensitive data that the user doesn't, etc. Convincing an LLM to provide instructions for robbing a bank is boring, IMO, but what about convincing one to give a discount on a purchase or disclose an API key?
varelse 2y ago
[dead]
jayd16 2y ago
These are common examples of failed jails. If they can't get this right they certainly won't get some HR, payroll, health, law, closed source dev, or NDA covered helper bot locked down securely.
- peterburkimsher 2y ago
  bot? or but?

Retr0id 2y ago

"LLM security" is more about making sure corporate chatbots don't say things that would embarrass their owners if screenshotted and posted on social media.

yieldcrv 2y ago
I think we should just address what is “embarrassing” then Twenty years ago I was in a group of old technology thought leaders who spent the meeting worried about people playing computer games as a character with a different gender as their own They wanted to find a way to prevent that, especially in an online setting To them, this would be embarrassing for the individual, for society, and for any corporation involved or intermediary But in reality this was the most absurd thing to even consider as a problem, it was always completely benign, was already commonplace, and nobody ever removed ad dollars or shareholder support or grants because of this reality The same will be true this “LLM security” field
- plaguuuuuu 2y ago
  It's not quite the same. "LLM security" is not security for the users, it's security for OpenAI etc against lawsuits or government enacting AI safety laws.
  - yieldcrv 2y ago
    the similarity being that it will remain a waste of time
- wredcoll 2y ago
  > Twenty years ago I was in a group of old technology thought leaders who spent the meeting worried about people playing computer games as a character with a different gender as their own Please, tell me more. I want, I need, all the details. This sounds hilarious.
blincoln 2y ago
It gets more interesting when someone gives the LLM the power to trigger actions outside of the chat, the LLM has access to genuinely sensitive data that the user doesn't, etc. Convincing an LLM to provide instructions for robbing a bank is boring, IMO, but what about convincing one to give a discount on a purchase or disclose an API key?

varelse 2y ago

[dead]

jayd16 2y ago

These are common examples of failed jails. If they can't get this right they certainly won't get some HR, payroll, health, law, closed source dev, or NDA covered helper bot locked down securely.

peterburkimsher 2y ago
bot? or but?