3 ms·

After all the decades of making every network layer secure one by one (even DNS now) people are literally giving a plaintext API to all their secrets and passwo

After all the decades of making every network layer secure one by one (even DNS now) people are literally giving a plaintext API to all their secrets and passwords. Also, there was so much outrage over Microsoft taking screenshots but nothing over this?

compootr 1y ago
at least this is opt-in (you must download the browser) Microsoft's idea was to create the perfect database of screenshots for stealer log software to grab on every windows machine (opt-out originally afaik)
- justsid 1y ago
  I’m all for people being allowed to use computers to shoot themselves in the foot. It’s my biggest issue with the mobile eco-system. But yes, the underlying OS ought to be conservative and not pull things like that. If I as a user want to opt into this that’s a different matter.
- moritzwarhier 1y ago
  Well I think at least a double-digit percentage of people could be persuaded to enter their e-mail credentials into a ChatGPT or Gemini interface – maybe even a more untrusted one –under the pretense of helping with some business idea or drafting a reply to an e-mail.
- chrisjj 1y ago
  Like the MS one was opt-in because you had to have Windows...
threecheese 1y ago
… or giving a “useful agent” data they wouldn’t give their friends. My wife just had ChatGPT make her a pill-taking plan. It did a fantastic job, taking into account meals, diet, sleep, and several pills with different constraints and contraindications. It also found that she was taking her medication incorrectly, which explained some symptoms she’s been having. I don’t know if it’s the friendly helpful agent tone, but she didnt even question giving over data which in another setting might cause a medical pro to lose their license, if it saved her an hour on a saturday.
- ModernMech 1y ago
  > It did a fantastic job, taking into account meals, diet, sleep, and several pills with different constraints and contraindications. How do you know though? I mean, it tells me all kinds of stuff that sound good about things I'm an expert in that I know are wrong. How do you know it hasn't done the same with your wife's medications? Seems like not a good thing to put your trust in if it can't reliably get things correct you know to be true. You say it explained your wife's symptoms, but that's what it's designed to do. I'm assuming she listed her symptoms into the system and asked for help, so it's not surprising it started to talk about them and gave suggestions for how to alleviate them. But I give it parameters for code to implement all the time and it can't reliably give me code that parses let alone works. So what's to say it's not also giving a medication schedule that "doesn't parse" under expert scrutiny?
- thrown-0825 1y ago
  your wife is going to trust an llm to make medical decisions for her?
  - chrisjj 1y ago
    Don't worry. This trait will be gone from the population in just a few generations...
    - osn9363739 1y ago
      People have bought snake oil since the dawn of time. People have blindly followed diet/medical/lifestyle influencers since long before the internet. It's not going away. I'm sure you have seen some plum on the internet say "Let food be thy medicine" before.
      - thrown-0825 1y ago
        Steve Jobs lmao
- latexr 1y ago
  What could go wrong with consulting ChatGPT for health and dietary matters… https://archive.ph/20250812200545/https://www.404media.co/guy-gives-himself-19th-century-psychiatric-illness-after-consulting-with-chatgpt/ https://archive.ph/20250812200545/https://www.404media.co/gu...
llm_nerd 1y ago
>Also, there was so much outrage over Microsoft taking screenshots but nothing over this? Whataboutism is almost always just noisy trolling nonsense, but this is next level.
rvz 1y ago
Don't worry, this is just the start. You will see an incident in how someone got their private keys, browser passwords leaked from this method of attack soon.

compootr 1y ago

at least this is opt-in (you must download the browser) Microsoft's idea was to create the perfect database of screenshots for stealer log software to grab on every windows machine (opt-out originally afaik)

justsid 1y ago
I’m all for people being allowed to use computers to shoot themselves in the foot. It’s my biggest issue with the mobile eco-system. But yes, the underlying OS ought to be conservative and not pull things like that. If I as a user want to opt into this that’s a different matter.
moritzwarhier 1y ago
Well I think at least a double-digit percentage of people could be persuaded to enter their e-mail credentials into a ChatGPT or Gemini interface – maybe even a more untrusted one –under the pretense of helping with some business idea or drafting a reply to an e-mail.
chrisjj 1y ago
Like the MS one was opt-in because you had to have Windows...

threecheese 1y ago

… or giving a “useful agent” data they wouldn’t give their friends. My wife just had ChatGPT make her a pill-taking plan. It did a fantastic job, taking into account meals, diet, sleep, and several pills with different constraints and contraindications. It also found that she was taking her medication incorrectly, which explained some symptoms she’s been having. I don’t know if it’s the friendly helpful agent tone, but she didnt even question giving over data which in another setting might cause a medical pro to lose their license, if it saved her an hour on a saturday.

ModernMech 1y ago
> It did a fantastic job, taking into account meals, diet, sleep, and several pills with different constraints and contraindications. How do you know though? I mean, it tells me all kinds of stuff that sound good about things I'm an expert in that I know are wrong. How do you know it hasn't done the same with your wife's medications? Seems like not a good thing to put your trust in if it can't reliably get things correct you know to be true. You say it explained your wife's symptoms, but that's what it's designed to do. I'm assuming she listed her symptoms into the system and asked for help, so it's not surprising it started to talk about them and gave suggestions for how to alleviate them. But I give it parameters for code to implement all the time and it can't reliably give me code that parses let alone works. So what's to say it's not also giving a medication schedule that "doesn't parse" under expert scrutiny?
thrown-0825 1y ago
your wife is going to trust an llm to make medical decisions for her?
- chrisjj 1y ago
  Don't worry. This trait will be gone from the population in just a few generations...
  - osn9363739 1y ago
    People have bought snake oil since the dawn of time. People have blindly followed diet/medical/lifestyle influencers since long before the internet. It's not going away. I'm sure you have seen some plum on the internet say "Let food be thy medicine" before.
    - thrown-0825 1y ago
      Steve Jobs lmao
latexr 1y ago
What could go wrong with consulting ChatGPT for health and dietary matters… https://archive.ph/20250812200545/https://www.404media.co/guy-gives-himself-19th-century-psychiatric-illness-after-consulting-with-chatgpt/ https://archive.ph/20250812200545/https://www.404media.co/gu...

llm_nerd 1y ago

>Also, there was so much outrage over Microsoft taking screenshots but nothing over this? Whataboutism is almost always just noisy trolling nonsense, but this is next level.

rvz 1y ago

Don't worry, this is just the start. You will see an incident in how someone got their private keys, browser passwords leaked from this method of attack soon.