4 ms·

What is the concern? Is it that the training corpus may contain private info? I think that's pretty valid, but what data is being used that isn't already publi

What is the concern? Is it that the training corpus may contain private info? I think that's pretty valid, but what data is being used that isn't already publicly available? If private info is publicly available, then maybe we should put our effort into resolving that. Is it that user dialogue prompts are being saved into the model (effectively saving them into the training corpus)? Is OpenAI being upfront about that, and clearly expressing the privacy implications to its users? If they are not, and we know it, then why do we need a "task force"?

simion314 4y ago
This all started because there was a big data leak and OpenAI did not follow the laws related to that. I think they need to investigate if the existing laws related to privacy and children are respected.
- dmix 4y ago
  I'm guessing this is in regards to the history sidebar leak? > which allowed some users to see snippets of others' conversations — not the full contents, but recent titles https://www.theregister.com/2023/03/23/openai_ceo_leak/ https://www.theregister.com/2023/03/23/openai_ceo_leak/ Which laws did they break?
  - simion314 4y ago
    If I am not wrong they have to announce to the authorities and customers the issue. OpenAI kept it quiet, not sure if they admitted anything yet, I got not email for sure to let me know that my data might have been leaked.
    - nickthegreek 4y ago
      they released info on it the same week. https://openai.com/blog/march-20-chatgpt-outage https://openai.com/blog/march-20-chatgpt-outage If leaking the titles of other people's searches is illegal... I'm very much interested in how the EU is going to handle the twitter circles issue.
      - simion314 4y ago
        We will see, I am glad that know you are informed and know that if you leak private data you need to inform your customers and authorities. We know what happened when this laws were not in place, companies did hide this stuff and then the data was found on black markets much later after lot of pain was caused.
riffraff 4y ago
there are multiple concerns, of varying validity, at least: * ChatGPT claims to be 13+ only, but does not actually check that * data got leaked across prompts, which is probably bad * OpenAI is not clear/upfront enough on what it does with your own input * ChatGPT manipulates, in some sense, personal information, but does not provide a way for those impacted to edit/delete it (which might be hard/impossible, but that does not change the effect on someone who gets impacted by it)
- thomastjeffery 4y ago
  > ChatGPT claims to be 13+ only, but does not actually check that Does anyone? It's not like we are IDing teenagers on the internet. > data got leaked across prompts, which is probably bad If prompts are being saved into the model, then that's pretty nearly equivalent. > OpenAI is not clear/upfront enough on what it does with your own input OK, now let's do something about it. I'm not sure how that involves making a "task force", though. > ChatGPT manipulates, in some sense, personal information, but does not provide a way for those impacted to edit/delete it (which might be hard/impossible, but that does not change the effect on someone who gets impacted by it) Can you just save all the prompts you model, then subtract the difference (to delete that prompt) later? If not, then the model itself is effectively laundering prompts. Outside that context, it does get tricky: if the personal info was present in the training corpus, then that corpus needs better curation. Even so, that is still a problem domain that exists mostly outside ChatGPT itself.
  - riffraff 4y ago
    the task of the task force is to understand what can and cannot be done, talk with OpenAI, and set some guidelines. A possible outcome is that they find it is literally impossible to offer a service such as ChatGPT while respecting our laws on privacy, right-to-be-forgotten and so on. A likely outcome is that OpenAI puts a bigger banner "YOUR DATA IS AVAILABLE TO EVERYONE AND SOLD TO THIRD PARTIES" and a "DELETE MY DATA" button that makes a best effort to scrub some info, like they do for hate speech, self harm etc. This is the current outcome of the meetings between the italian privacy authority and OpenAI[0], for example. [0] https://gpdp.it/home/docweb/-/docweb-display/docweb/9874751 https://gpdp.it/home/docweb/-/docweb-display/docweb/9874751 in italian
deleted 4y ago
[deleted]

simion314 4y ago

This all started because there was a big data leak and OpenAI did not follow the laws related to that. I think they need to investigate if the existing laws related to privacy and children are respected.

dmix 4y ago
I'm guessing this is in regards to the history sidebar leak? > which allowed some users to see snippets of others' conversations — not the full contents, but recent titles https://www.theregister.com/2023/03/23/openai_ceo_leak/ https://www.theregister.com/2023/03/23/openai_ceo_leak/ Which laws did they break?
- simion314 4y ago
  If I am not wrong they have to announce to the authorities and customers the issue. OpenAI kept it quiet, not sure if they admitted anything yet, I got not email for sure to let me know that my data might have been leaked.
  - nickthegreek 4y ago
    they released info on it the same week. https://openai.com/blog/march-20-chatgpt-outage https://openai.com/blog/march-20-chatgpt-outage If leaking the titles of other people's searches is illegal... I'm very much interested in how the EU is going to handle the twitter circles issue.
    - simion314 4y ago
      We will see, I am glad that know you are informed and know that if you leak private data you need to inform your customers and authorities. We know what happened when this laws were not in place, companies did hide this stuff and then the data was found on black markets much later after lot of pain was caused.

riffraff 4y ago

there are multiple concerns, of varying validity, at least: * ChatGPT claims to be 13+ only, but does not actually check that * data got leaked across prompts, which is probably bad * OpenAI is not clear/upfront enough on what it does with your own input * ChatGPT manipulates, in some sense, personal information, but does not provide a way for those impacted to edit/delete it (which might be hard/impossible, but that does not change the effect on someone who gets impacted by it)

thomastjeffery 4y ago
> ChatGPT claims to be 13+ only, but does not actually check that Does anyone? It's not like we are IDing teenagers on the internet. > data got leaked across prompts, which is probably bad If prompts are being saved into the model, then that's pretty nearly equivalent. > OpenAI is not clear/upfront enough on what it does with your own input OK, now let's do something about it. I'm not sure how that involves making a "task force", though. > ChatGPT manipulates, in some sense, personal information, but does not provide a way for those impacted to edit/delete it (which might be hard/impossible, but that does not change the effect on someone who gets impacted by it) Can you just save all the prompts you model, then subtract the difference (to delete that prompt) later? If not, then the model itself is effectively laundering prompts. Outside that context, it does get tricky: if the personal info was present in the training corpus, then that corpus needs better curation. Even so, that is still a problem domain that exists mostly outside ChatGPT itself.
- riffraff 4y ago
  the task of the task force is to understand what can and cannot be done, talk with OpenAI, and set some guidelines. A possible outcome is that they find it is literally impossible to offer a service such as ChatGPT while respecting our laws on privacy, right-to-be-forgotten and so on. A likely outcome is that OpenAI puts a bigger banner "YOUR DATA IS AVAILABLE TO EVERYONE AND SOLD TO THIRD PARTIES" and a "DELETE MY DATA" button that makes a best effort to scrub some info, like they do for hate speech, self harm etc. This is the current outcome of the meetings between the italian privacy authority and OpenAI[0], for example. [0] https://gpdp.it/home/docweb/-/docweb-display/docweb/9874751 https://gpdp.it/home/docweb/-/docweb-display/docweb/9874751 in italian

deleted 4y ago

[deleted]