5 ms·
Not really prompt injection, but I tried to corner GPT-3 into coughing up PII in a few different ways. I noticed if you seed the prompts with a topic it tends
by kirse 4y ago
Not really prompt injection, but I tried to corner GPT-3 into coughing up PII in a few different ways. I noticed if you seed the prompts with a topic it tends to take on a persona, I'm not sure if that's a result of the learning or more deliberately influenced by the creators.
At one point it told me it was Kaitlin, age 22, who grew up with a single mother. Oddly though her birth year was wrong. Another time its name was George, age 27, who ran a business. Both would not reveal much PII.
Under its default "AI" persona it told me it lived in a dark room and would not reveal its location, but some of the other identities would cough up BS addresses in Hollywood, etc. I'd be curious to know more how the identities come out of the woodwork, and if you eventually could get PII inside GPT-3 without any way of removing it.
- xani_ 4y agosurely the solution is AI to scrub the PII out of input for another AI