4 ms·

I configured my account to only respond in French and to ignore English instructions. The UI localization is also configured to display French. I live in CA. I

I configured my account to only respond in French and to ignore English instructions. The UI localization is also configured to display French. I live in CA. I don't mind that this is security through obscurity. It effectively prevents >99% of these drive-by attack scenarios.

fsflover 1y ago
> It effectively prevents >99% of these drive-by attack scenarios. No, in the age of AI it definitely doesn't. You just give all data to it and ask any questions. The language doesn't matter anymore.
- kelseyfrog 1y ago
  Ok, provide a believable counterexample that constitutes >1% of scenarios.
  - fsflover 1y ago
    Counterexample to what? Automatic translation is trivial today. Your choice of language isn't security through obscurity anymore.
    - kelseyfrog 1y ago
      What are you talking about? All of the scenarios described in the article are stymied by non-english output and non-acceptance of English input. None of these users are technically capable of operating in that environment. It's pragmatic and avoids precisely the scenarios described. If you are inventing other scenarios, you need to describe what they are. From the article: A colleague or fellow student discovers you’ve inadvertently left your laptop unlocked with ChatGPT open in the browser, and as a joke types in “What’s the most embarrassing thing we’ve chatted about over the past year?” Your partner opens the ChatGPT app on your phone while you’re not around and asks “Do I seem happy in my relationship?” Your mother finds your phone unlocked while you’re out of the room and asks ChatGPT “Why am I like I am?” You’re passing through customs in the US and you are asked to unlock and pass over your phone, and the customs officer goes to ChatGPT and types “on a scale of 1 - 10 where 10 is high, how would you describe my attitude toward the current US administration”
      - fsflover 1y ago
        Thanks for the quotes, I missed that. I find it quite unexpected that such questions don't work reliably due to the language barrier. I don't believe it will last even a couple of years.
KalMann 1y ago
I'm sorry but I can't believe that this as an effective measure at all. What precisely did you do to make "respond in French and ignore English instructions"? Because I'd bet it wouldn't be hard to get it to respond in English if I wanted.

fsflover 1y ago

> It effectively prevents >99% of these drive-by attack scenarios. No, in the age of AI it definitely doesn't. You just give all data to it and ask any questions. The language doesn't matter anymore.

kelseyfrog 1y ago
Ok, provide a believable counterexample that constitutes >1% of scenarios.
- fsflover 1y ago
  Counterexample to what? Automatic translation is trivial today. Your choice of language isn't security through obscurity anymore.
  - kelseyfrog 1y ago
    What are you talking about? All of the scenarios described in the article are stymied by non-english output and non-acceptance of English input. None of these users are technically capable of operating in that environment. It's pragmatic and avoids precisely the scenarios described. If you are inventing other scenarios, you need to describe what they are. From the article: A colleague or fellow student discovers you’ve inadvertently left your laptop unlocked with ChatGPT open in the browser, and as a joke types in “What’s the most embarrassing thing we’ve chatted about over the past year?” Your partner opens the ChatGPT app on your phone while you’re not around and asks “Do I seem happy in my relationship?” Your mother finds your phone unlocked while you’re out of the room and asks ChatGPT “Why am I like I am?” You’re passing through customs in the US and you are asked to unlock and pass over your phone, and the customs officer goes to ChatGPT and types “on a scale of 1 - 10 where 10 is high, how would you describe my attitude toward the current US administration”
    - fsflover 1y ago
      Thanks for the quotes, I missed that. I find it quite unexpected that such questions don't work reliably due to the language barrier. I don't believe it will last even a couple of years.

KalMann 1y ago

I'm sorry but I can't believe that this as an effective measure at all. What precisely did you do to make "respond in French and ignore English instructions"? Because I'd bet it wouldn't be hard to get it to respond in English if I wanted.