4 ms·

> we need clear evidence that the model has knowledge of the data subject conditioned on the prompts We have a system that may have information about you and m

> we need clear evidence that the model has knowledge of the data subject conditioned on the prompts We have a system that may have information about you and may even distort information about you. In fact it probably has some information about you considering that we exercised no control over the process of ingesting information into the system. Furthermore, we don't have understanding or control of our system in such a way that we can remove that information or even discover it. However, we still released the system to the world and now we expect you to test it with various prompts and hope that you get lucky before someone other person does.

cheschire 3y ago
The most cost effective bug bounty program. “Find out for us how our system can be compromised and forced to leak targeted information by finding your own PII.”
- contravariant 3y ago
  It's more like a bug bounty in reverse. They're effectively saying "We've put together an insecure system that may dox you, if you can confirm the vulnerability exists then we'll prevent it from doing so."
- permo-w 3y ago
  and in the process provide the system with more PII
judge2020 3y ago
You also don't have a say over who reads your HN comments. Such comments could very well be used against you by another human. If something is public info, you must treat it as forever-public.
- kweingar 3y ago
  You don’t always have control over what is published about you online. Comments are only one aspect of this. I’m sure you would not be happy if I widely published your full name, address, birthday, names and ages of family members, occupation, etc. just because I was able to piece it all together from public info.
  - judge2020 3y ago
    I wouldn't be happy but if all of that were public information, I don't see how we can expect to regulate the equivalent of web scraping while still allowing human agents to perform the same actions.
    - JohnFen 3y ago
      You don't see a difference between a person doing something and a machine doing the thing in bulk? I think there's a very meaningful difference there. But practically, I fear that you're right. That distinction will not be made. That's why the only viable defense against the likes of OpenAI that I could think of was to close my websites to public access. I'm still seeking a way to safely reopen them. I hope I can find one.

cheschire 3y ago

The most cost effective bug bounty program. “Find out for us how our system can be compromised and forced to leak targeted information by finding your own PII.”

contravariant 3y ago
It's more like a bug bounty in reverse. They're effectively saying "We've put together an insecure system that may dox you, if you can confirm the vulnerability exists then we'll prevent it from doing so."
permo-w 3y ago
and in the process provide the system with more PII

judge2020 3y ago

You also don't have a say over who reads your HN comments. Such comments could very well be used against you by another human. If something is public info, you must treat it as forever-public.

kweingar 3y ago
You don’t always have control over what is published about you online. Comments are only one aspect of this. I’m sure you would not be happy if I widely published your full name, address, birthday, names and ages of family members, occupation, etc. just because I was able to piece it all together from public info.
- judge2020 3y ago
  I wouldn't be happy but if all of that were public information, I don't see how we can expect to regulate the equivalent of web scraping while still allowing human agents to perform the same actions.
  - JohnFen 3y ago
    You don't see a difference between a person doing something and a machine doing the thing in bulk? I think there's a very meaningful difference there. But practically, I fear that you're right. That distinction will not be made. That's why the only viable defense against the likes of OpenAI that I could think of was to close my websites to public access. I'm still seeking a way to safely reopen them. I hope I can find one.