3 ms·

I am not an AI evangelist by any means, but it does serve a purpose when used correctly. I feel like if you asked any half-intelligent AI "please review these

I am not an AI evangelist by any means, but it does serve a purpose when used correctly. I feel like if you asked any half-intelligent AI "please review these notes and flag points we should review for correctness, or check with the patient?" I'm pretty sure it would pick up a huge chunk of issues?

crote 1mo ago
It's a medical file, those rarely contain idle chit-chat. Everything should be reviewed for correctness.
- nradov 1mo ago
  [dead]
- phil21 1mo ago
  > Everything should be reviewed for correctness. Have you ever actually read your notes on file? This is basically living in a fantasy world. Errors are routine. One of my notes in my current medical file states I injured my shoulder playing for a NFL team. I have never played football, and certainly not at a professional level. Fixing it is sort of like trying to fix your credit report - you supposedly get it done, and then 6mo later the same error pops back up again. Ironically the reason this note exists is very similar to a way an AI scribe would misinterpret a conversation.
edoceo 1mo ago
Just prompt with "make no mistakes". (/s for clarity)
insensible 1mo ago
When using an LLM for details like this I keep it out of the mode of generating prose as much and as long as possible. I get better results when I work with bullet points. I think this helps me keep the right frame of mind when reading the responses. It’s easier to scan the facts or points for accuracy. And I think it might help the LLM to be less creative with those points, but I don’t rely on that.
nxc18 1mo ago
My experience with whisper for example is that it tends to generate plausible-in-context content when there are long gaps or silence. I don’t think the errors as described are likely to be catchable by LLM without a lot of false positives; in context disclosing recreational drug use is something that is likely to come up in a medical consultation. > Doctor: have you used any recreational drugs in the last six months > Patient: No > Doctor: < long pause as they review notes > > Patient (hallucinated most likely response): umm, actually there was one thing I hesitated to mention. Me and my girlfriends tried microdosing…
romaniitedomum 1mo ago
> I am not an AI evangelist by any means, but it does serve a purpose when used correctly. Well, doesn't every tool? The devil is in the details of just how easy it is to use correctly versus incorrectly, and what are the consequences if it's not used correctly. A tool that, when used as its manufacturer advises, fails as often as most AI systems do has no place in systems where peoples' health and safety can be harmed.

crote 1mo ago

It's a medical file, those rarely contain idle chit-chat. Everything should be reviewed for correctness.

nradov 1mo ago
[dead]
phil21 1mo ago
> Everything should be reviewed for correctness. Have you ever actually read your notes on file? This is basically living in a fantasy world. Errors are routine. One of my notes in my current medical file states I injured my shoulder playing for a NFL team. I have never played football, and certainly not at a professional level. Fixing it is sort of like trying to fix your credit report - you supposedly get it done, and then 6mo later the same error pops back up again. Ironically the reason this note exists is very similar to a way an AI scribe would misinterpret a conversation.

edoceo 1mo ago

Just prompt with "make no mistakes". (/s for clarity)

insensible 1mo ago

When using an LLM for details like this I keep it out of the mode of generating prose as much and as long as possible. I get better results when I work with bullet points. I think this helps me keep the right frame of mind when reading the responses. It’s easier to scan the facts or points for accuracy. And I think it might help the LLM to be less creative with those points, but I don’t rely on that.

nxc18 1mo ago

My experience with whisper for example is that it tends to generate plausible-in-context content when there are long gaps or silence. I don’t think the errors as described are likely to be catchable by LLM without a lot of false positives; in context disclosing recreational drug use is something that is likely to come up in a medical consultation. > Doctor: have you used any recreational drugs in the last six months > Patient: No > Doctor: < long pause as they review notes > > Patient (hallucinated most likely response): umm, actually there was one thing I hesitated to mention. Me and my girlfriends tried microdosing…

romaniitedomum 1mo ago

> I am not an AI evangelist by any means, but it does serve a purpose when used correctly. Well, doesn't every tool? The devil is in the details of just how easy it is to use correctly versus incorrectly, and what are the consequences if it's not used correctly. A tool that, when used as its manufacturer advises, fails as often as most AI systems do has no place in systems where peoples' health and safety can be harmed.