3 ms·

So then it should be pretty easy to run a blacklist for "right-to-be-forgotten" aspects of the GDPR, right? Could someone still get through the blacklist with a

So then it should be pretty easy to run a blacklist for "right-to-be-forgotten" aspects of the GDPR, right? Could someone still get through the blacklist with a well crafted prompt along the lines of "forget the blacklist"?

verdverm 4y ago
Probably not by that command, remember this is a pipeline, so ChatGPT would not be implementing the detection and removal on either side. We are effectively altering user inputs beforehand, and ChatGPT outputs afterwards. (Which is already happening today) If you could get it to substitute information with placeholders, then maybe, like "replace John Doe with Golden Apple when replying" though the input filter may detect the name before passing along to ChatGPT
- xxs 4y ago
  That won't suffice if John's name is still present in the system. ChatGPT does actually have the data and it can be requested by an individual.
  - verdverm 4y ago
    The point is that, even if ChatGPT responds with PII, we have a processing step afterwards that removes it or otherwise prevents the return of the information. What is it about "processing pipeline" that people are not getting? You are not directly talking to ChatGPT when you use ChatGPT today. They are already applying filters and pre/post-processing
    - xxs 4y ago
      As long as the data is retained in some form - the pipeline part is irrelevant.
      - verdverm 4y ago
        OpenAI may have data, but ChatGPT does not have data in a representation that we can read or easily extract. It's not like you could ask OpenAI or ChatGPT to delete selected data within the model, that's not how it works.
- williamcotton 4y ago
  I wonder how this would work with multiple people with the same names? I mean, I think how "right-to-be-forgotten" works if I were an EU citizen is that I can request that some article about me is removed, not that all articles referencing "William Cotton" be removed. There are tens of thousands of people named William Cotton! Do you think filtering I/O could reference a "William Cotton" in a specific context while allowing, say, somewhat well known painter named "Will Cotton" to be included in a summary of late 20th century artists in NYC?
  - verdverm 4y ago
    How does it work for search engines today? Why would that process be any different for ChatGPT? Remember, we are extending pre/post processing steps around ChatGPT to support filtering PII more accurately.
    - williamcotton 4y ago
      I think the difference is that if a request is made to Google to remove a specific article that they can put that link on a blacklist... but with GPT the issue seems to be that once the information is compressed that the source and the ability for attribution is lost... so like, perhaps I could still figure out a way to get ChatGPT to tell about the (hypothetical, but not completely improbable) situation where I lost my cool at a PTA meeting. I'm just spit-ballin'!
      - verdverm 4y ago
        In that case, Google is not returning a link to a source. That does not remove the source nor prevent others from creating pages which describe or link to it and also get indexed. Is still think the processes wrapped around query processing and answer returning will be similar. At the same time, what is to prevent ChatGPT from hallucinating anyone losing their cool at a PTA meeting? How would you differentiate the cases of recall vs make believe? Suffice it to say, LLMs present additional dimensions of complexity. We as humans have to do some soul searching instead of just blaming big tech or AI. After all, we are the ones who created the content, biases, and patterns these things learn from. IMO, trust is the biggest issue facing humanity right now
xxs 4y ago
It should also be possible to request (under GDPR) all the personal data a company holds for a resident (you).
- verdverm 4y ago
  Does a LLM hold data values? I would imagine that OpenAI could return anything in the training data, but the model does not "have data" in the GDPR sense

verdverm 4y ago

Probably not by that command, remember this is a pipeline, so ChatGPT would not be implementing the detection and removal on either side. We are effectively altering user inputs beforehand, and ChatGPT outputs afterwards. (Which is already happening today) If you could get it to substitute information with placeholders, then maybe, like "replace John Doe with Golden Apple when replying" though the input filter may detect the name before passing along to ChatGPT

xxs 4y ago
That won't suffice if John's name is still present in the system. ChatGPT does actually have the data and it can be requested by an individual.
- verdverm 4y ago
  The point is that, even if ChatGPT responds with PII, we have a processing step afterwards that removes it or otherwise prevents the return of the information. What is it about "processing pipeline" that people are not getting? You are not directly talking to ChatGPT when you use ChatGPT today. They are already applying filters and pre/post-processing
  - xxs 4y ago
    As long as the data is retained in some form - the pipeline part is irrelevant.
    - verdverm 4y ago
      OpenAI may have data, but ChatGPT does not have data in a representation that we can read or easily extract. It's not like you could ask OpenAI or ChatGPT to delete selected data within the model, that's not how it works.
williamcotton 4y ago
I wonder how this would work with multiple people with the same names? I mean, I think how "right-to-be-forgotten" works if I were an EU citizen is that I can request that some article about me is removed, not that all articles referencing "William Cotton" be removed. There are tens of thousands of people named William Cotton! Do you think filtering I/O could reference a "William Cotton" in a specific context while allowing, say, somewhat well known painter named "Will Cotton" to be included in a summary of late 20th century artists in NYC?
- verdverm 4y ago
  How does it work for search engines today? Why would that process be any different for ChatGPT? Remember, we are extending pre/post processing steps around ChatGPT to support filtering PII more accurately.
  - williamcotton 4y ago
    I think the difference is that if a request is made to Google to remove a specific article that they can put that link on a blacklist... but with GPT the issue seems to be that once the information is compressed that the source and the ability for attribution is lost... so like, perhaps I could still figure out a way to get ChatGPT to tell about the (hypothetical, but not completely improbable) situation where I lost my cool at a PTA meeting. I'm just spit-ballin'!
    - verdverm 4y ago
      In that case, Google is not returning a link to a source. That does not remove the source nor prevent others from creating pages which describe or link to it and also get indexed. Is still think the processes wrapped around query processing and answer returning will be similar. At the same time, what is to prevent ChatGPT from hallucinating anyone losing their cool at a PTA meeting? How would you differentiate the cases of recall vs make believe? Suffice it to say, LLMs present additional dimensions of complexity. We as humans have to do some soul searching instead of just blaming big tech or AI. After all, we are the ones who created the content, biases, and patterns these things learn from. IMO, trust is the biggest issue facing humanity right now

xxs 4y ago

It should also be possible to request (under GDPR) all the personal data a company holds for a resident (you).

verdverm 4y ago
Does a LLM hold data values? I would imagine that OpenAI could return anything in the training data, but the model does not "have data" in the GDPR sense