4 ms·

I think this is a flawed outlook. My wife works in healthcare and they just announced that AI would generate 50% of their documents. According to my wife, eve

I think this is a flawed outlook. My wife works in healthcare and they just announced that AI would generate 50% of their documents. According to my wife, every in every review she's done of the work, there are critical errors in logic or reasoning (hallucinations), but leadership doesn't care because they a "grading" the AI on things like grammar and spelling. So, yay, it spelled "fusospirochetosis" correctly, but unfortunately it attributed that to a 23 year old woman who came in for a broken arm. I think we need to be prepared for "vibe coding" taking over every industry. Leadership is going to blindly implement broken AI to replace workers. Now, you might think that threat of lawsuits, regulations, and ethics standards will save your industry. And maybe that's true, but I personally don't think so. I personally think we are going to see country-scale enshitification of everything as lazy people use AI to generate everything which is then reviewed by lazy people who also use AI to review everything and no one notices or cares until it's too late (and maybe not even then). I hope you're right, but I'm not convinced.

mrweasel 2y ago
> I personally think we are going to see country-scale enshitification of everything as lazy people use AI to generate everything which is then reviewed by lazy people who also use AI to review everything and no one notices or cares until it's too late Sound about right to me. A large quantity of documentation is written solely to be written, not read. If it's your job to write reports, article, memos, whatever, and you deep down know that this isn't being read, then why not have to AI do it? I think that we're producing way to many documents/reports/content in general and we need to slow down. Humans can't keep up, neither on the production side, nor the consumption, so we employ computers to "help", but it's all busy work.
- eulers_secret 2y ago
  This reminds me of my first internship, I was running a test suite and filling out a web form every week. It was never mentioned in any meetings or other comms. After about 3 months of doing this, I asked my manager why I was doing this if no-one cared or noticed. He told me to stop and see if anyone said something. I stopped, interned another 15 months and it wasn't ever mentioned. Hell of a lesson to learn as a newbie
  - johnnyanmac 2y ago
    3 months later a showstopper occurs and heads are rolling. The poor release manager wants to pinpoint when this breaking change occurred, but the last test suite ran was almost 2 years ago. They didn't care until it was too late. As fitting for American culture. Not saying you were wrong to drop, but multiple people dropped the BL there if there how they are treating their testing.
- mmcconnell1618 2y ago
  Idiocracy in real life. The AI told me to drink Brawndo. Why? Because it has electrolytes. My AI said electrolytes are good.
- johnnyanmac 2y ago
  >documentation is written solely to be written, not read. If it's your job to write reports, article, memos, whatever, and you deep down know that this isn't being read, then why not have to AI do it? Medical records seems to be the opposite of this. Nurses document to report to doctors so they can diagnose and advise. That seems like the worst step to cut corners on. Accountants document reports for patient for prescriptions and diagnosis that can affect their lives. Heck, as a CYA you document records in case a law firm comes in demanding papers to read. Do they think lawyers don't care about this stuff? Just because not everyone is gonna pour over ever word doesn't mean no one will.
thechao 2y ago
Idiocracy was supposed to be funny, not terrifying.
carabiner 2y ago
Profit and a competitive market are powerful incentives that keep people from dying in the industry of human transport, that don't exist as much in hospitals. Also, if you think "threat of lawsuits, regulations, and ethics standards" don't encourage safe cars or airplanes currently, what do you think does? In engineering currently there are 1,000 ways to cheat (and sometimes they do, like Volkswagen dieselgate), but reports are actually checked rigorously multiple times by other engineers at a company and by federal regulators (who are also engineers). Things get rejected and changed based on these reviews. Why would AI engineering make this different? If AI could cause a fiasco on the level of Toyota's unintended acceleration debacle from 2008, which caused the largest auto recall in history, that is something that would give pause to using AI, no? If AI leads to bad products that kill people, companies will lose money and they will not want to use AI.
pianoben 2y ago
"Medical (vibe) Coding" Oh lord, that is a phrase I did not need to think about today
- Karsteski 2y ago
  I am quite literally sleeping in a hospital while I read that. Horrifying.
BlarfMcFlarf 2y ago
Certainly you won’t be saved in the US, where things like consumer protections are quickly becoming a thing of the past. And the US has traditionally exported its business practices to the world.
johnnyanmac 2y ago
Why is it that lazy people are kicking out the motivated? I thought you had to be motivated to move up in the world? Or to understand and interpret law? Or to not take complete trite from a 20 yo MBA who just see numbers instead of lives?

mrweasel 2y ago

> I personally think we are going to see country-scale enshitification of everything as lazy people use AI to generate everything which is then reviewed by lazy people who also use AI to review everything and no one notices or cares until it's too late Sound about right to me. A large quantity of documentation is written solely to be written, not read. If it's your job to write reports, article, memos, whatever, and you deep down know that this isn't being read, then why not have to AI do it? I think that we're producing way to many documents/reports/content in general and we need to slow down. Humans can't keep up, neither on the production side, nor the consumption, so we employ computers to "help", but it's all busy work.

eulers_secret 2y ago
This reminds me of my first internship, I was running a test suite and filling out a web form every week. It was never mentioned in any meetings or other comms. After about 3 months of doing this, I asked my manager why I was doing this if no-one cared or noticed. He told me to stop and see if anyone said something. I stopped, interned another 15 months and it wasn't ever mentioned. Hell of a lesson to learn as a newbie
- johnnyanmac 2y ago
  3 months later a showstopper occurs and heads are rolling. The poor release manager wants to pinpoint when this breaking change occurred, but the last test suite ran was almost 2 years ago. They didn't care until it was too late. As fitting for American culture. Not saying you were wrong to drop, but multiple people dropped the BL there if there how they are treating their testing.
mmcconnell1618 2y ago
Idiocracy in real life. The AI told me to drink Brawndo. Why? Because it has electrolytes. My AI said electrolytes are good.
johnnyanmac 2y ago
>documentation is written solely to be written, not read. If it's your job to write reports, article, memos, whatever, and you deep down know that this isn't being read, then why not have to AI do it? Medical records seems to be the opposite of this. Nurses document to report to doctors so they can diagnose and advise. That seems like the worst step to cut corners on. Accountants document reports for patient for prescriptions and diagnosis that can affect their lives. Heck, as a CYA you document records in case a law firm comes in demanding papers to read. Do they think lawyers don't care about this stuff? Just because not everyone is gonna pour over ever word doesn't mean no one will.

thechao 2y ago

Idiocracy was supposed to be funny, not terrifying.

carabiner 2y ago

Profit and a competitive market are powerful incentives that keep people from dying in the industry of human transport, that don't exist as much in hospitals. Also, if you think "threat of lawsuits, regulations, and ethics standards" don't encourage safe cars or airplanes currently, what do you think does? In engineering currently there are 1,000 ways to cheat (and sometimes they do, like Volkswagen dieselgate), but reports are actually checked rigorously multiple times by other engineers at a company and by federal regulators (who are also engineers). Things get rejected and changed based on these reviews. Why would AI engineering make this different? If AI could cause a fiasco on the level of Toyota's unintended acceleration debacle from 2008, which caused the largest auto recall in history, that is something that would give pause to using AI, no? If AI leads to bad products that kill people, companies will lose money and they will not want to use AI.

pianoben 2y ago

"Medical (vibe) Coding" Oh lord, that is a phrase I did not need to think about today

Karsteski 2y ago
I am quite literally sleeping in a hospital while I read that. Horrifying.

BlarfMcFlarf 2y ago

Certainly you won’t be saved in the US, where things like consumer protections are quickly becoming a thing of the past. And the US has traditionally exported its business practices to the world.

johnnyanmac 2y ago

Why is it that lazy people are kicking out the motivated? I thought you had to be motivated to move up in the world? Or to understand and interpret law? Or to not take complete trite from a 20 yo MBA who just see numbers instead of lives?