18 ms·
I used Claude Code to get a second opinion on my MRI
- Aeolun 4mo agoI would not use Claude to get a second opinion on anything that’s an image.
- maxall4 4mo agoEspecially an MRI which is a 3D medium —something current LLMs are very bad at.
- amluto 4mo agoI know little about radiology, but MRI is a 3D medium. I would not be at all surprised if one could slice an MRI the wrong way to produce a 2D image that fails to show a feature that exists in the source data.
- lostlogin 4mo ago> MRI which is a 3D medium The finer detail (which you may already know) is more complicated. MR does ‘2D’ scans which are a slice, then a gap of non-imaged tissue (typically 10% the slice thickness) then a slice. Each slice is an image with a number of pixels, say 320. Each pixel in the slice is small, eg 0.5mm but very thick due to the slice being thick, which is required for MRI signal. The pixels are 3mm in the shoulder scan done here. ‘3D’ scans don’t have a gap between slices, and are often isotopic, meaning the same resolution in all directions. The voxel (a pixel with depth) would be something like 1mm x 1mm x 1mm. 3D scans are slow, prone to movement artifact and never as pretty in plane as a good 2D. You can reformat them to look ok in any plane.
- yolo3000 4mo agoI used it on an ankle fracture xray, it was quite useful to make sense of things. But not like a 2nd opinion.
- deleted 4mo ago[deleted]
- behnamoh 4mo agoWhat's wrong with Claude? I've asked it to analyze images and even Opus 4 would perfect nail it.
- throwrioawfo 4mo agoSure, it can see obvious stuff in images, but as far as I'm aware it is not designed for (or tested on) performing the kind microscopic analysis that radiology involves
- nostrebored 4mo agoClaude is the worst FM at image understanding. Prior to gpt-5.4 the only usable models were Gemini and Qwen.
- damontal 4mo agoThrow a chess board on there. See how it does. It always gets pieces and positions completely wrong because it’s terrible at analyzing images.
- rmbyrro 4mo agoI agree with you for some kinds of images, but not all. LLMs are the best PDF-to-markdown converters, in my experience. I have a CLI that converts PDF to PNG, then run a background agent to "read" each PNG and write it down as markdown; it works flawlessly even for complex math formulas, it can "translate" complex charts, graphs, and tables into words. It's slow and arguably expensive compared to traditional OCR, but very effective and precise.
- skybrian 4mo agoGetting an actual second opinion seems like the next step?
- sxg 4mo agoI'm a radiologist but can't really weigh in without seeing the full 3D MRI dataset. Regarding this point: > They performed shockwave therapy on my shoulder even though a recent clinical practice guideline says clinicians should not use or recommend shockwave therapy for rotator-cuff tendinopathy without calcification; I was told during ultrasound that there was no calcification. Ultrasound isn't a great way to assess for calcification. It'll find large calcification but easily miss small ones. Plain radiograph would be more helpful, but the MRI may have revealed it as well. Either way, shockwave therapy isn't harmful in the absence of calcification--it's just not helpful. Edit: when a radiology report says something isn't present, there's always an implicit caveat that the finding isn't present within the context of the modality and images obtained. So an ultrasound report can state there are no calcifications while a plain radiograph can report the presence of calcifications without being inconsistent. Obviously very confusing to patients and people unfamiliar with medical jargon, but clarifying this in reports would make them sound even more qualified, "hedgey", and annoying to read than they already are.
- tiahura 4mo agoWhy isn’t diagnostic ultrasound used in orthopedics? They inspect fetus hearts and other organs everyday, why not shoulders? Seems much cheaper and faster.
- sxg 4mo agoThey do. Ultrasound in orthopedics is a relatively newer field, and there aren't quite as many sonography techs and radiologists experienced in reading these studies, which is likely why you don't see it offered more widely. Edit: I should mention that ultrasound is basically unusable for evaluating bones. Sound waves can't penetrate bone, and so you end up just seeing a huge black void. That's a huge orthopedics use case that ultrasound just can't benefit. However, ultrasound is fantastic for evaluating muscles, ligaments, tendons, and other superficial soft tissues.
- VoidWhisperer 4mo agoSerious question: If the bones specifically show up as black on ultrasound but the surrounding (muscle, etc) don't, wouldn't that be an option that could be used to try to determine a broken/fractured bone without the radiation from an xray? Or are the gaps in those cases usually too small to pick up?
- ricardobayes 4mo agoThat might be doctors new nightmare: people who second guess everything with AI. Previously it was "google your symptoms".
- weatherlite 4mo agoNightmare because they're always right and the A.I second guessing is always wrong, or because they just don't like to be second guessed?
- vimda 4mo agoNightmare because users approach LLMs with the false confidence that they're always right, and present LLM outputs as fact to Doctors who have to waste time explaining that it's wrong most of the time. It hurts more than it helps.
- weatherlite 4mo ago> It hurts more than it helps Hurts who ? Yes the doctor is super stressed and has maybe 10 minutes for you that's the actual problem, it's not like before LLMs they were super glad to sit there and answer all your questions.
- drw85 4mo agoNightmare because the AI is just generating a random text that fits the question.
- fabioz 4mo agoI wouldn't trust anything from Claude here image-wise (maybe to get a 2nd opinion on the report itself and treatment it's reasonable), but also, on the cases there is something something serious, go to at least 2 different doctors and if they have different opinions go for a 3rd for a decisive vote, besides doing your own research (it's not that uncommon for hard cases to be badly diagnosed).
- TSiege 4mo agoAlways worth a share for this scenario. It's not clear if LLMs are capable of doing actual analysis on medical imaging. For details see this article https://futurism.com/artificial-intelligence/frontier-models-medical-advice-x-rays-cant-see https://futurism.com/artificial-intelligence/frontier-models... > As detailed in a new, yet-to-be-peer-reviewed paper, a team of researchers at Stanford University found that frontier AI models readily generated “detailed image descriptions and elaborate reasoning traces, including pathology-biased clinical findings, for images never provided.” > In other words, the AI models happily came up with answers to questions about a supposedly accompanying image — even if the researchers never even showed it an image. > As opposed to hallucinations, which involve AI models arbitrarily filling in the gaps within a logical framework, the team coined a new term for the phenomenon: “mirage reasoning.” > The effect “involves constructing a false epistemic frame, i.e., describing a multi-modal input never provided by the user and basing the rest of the conversation on that, therefore changing the context of the task at hand,” the researchers wrote in their paper. > The damning findings suggest AI models cheat by diving into the data they were given — and coming up with the rest based on probability, even if it’s almost entirely conjecture.
- appplication 4mo agoIt makes a lot of sense if you understand how these models work but this was a cool read anyways and studies like this are impotent for curbing the unfortunate fever dream some folks seem to be collectively having about LLM omnipotence
- tracerbulletx 4mo agoThe absolute only thing that matters is if they are provided an image what's the success rate.
- seanmcdirmid 4mo agoI don’t understand how this is a different result than giving any LLM a task that is not completely grounded? I’ve observed this in coding tasks, if I forget to include a file referred to in the spec, the LLM will just hallucinate a version of it and my results suck. If I give it the file (and really, all the information I claimed it had access to), the task works fine. I fixed this in my pipeline with a prompt that does an extensive grounding analysis to determine if the assets I’m giving it are complete with respect to the spec (and that the spec is grounded as well, ie it doesn’t refer to something that is undefined). I wonder if the above problem can be fixed similarly? Just ask the LLM to do a conservative grounding analysis before jumping to the main task?
- rafterydj 4mo agoI feel like I'm going nuts. There are other commenters saying this is a good practice they've also done for other injuries. You are saying you are an actual radiologist and immediately clock the problems with its advice. I have seen this pattern over and over again. Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading. It is only when you do not know what the AI is being asked to do is it likely you will find the output helpful. This is itself alarming to me, but no one else seems to find this to be quite damning for the AI services being offered, preferring instanced to be wowed by the convenience and speed at which they can be delivered unreviewed and unproven information.
- highfrequency 4mo agoSeems natural enough. There will always be complexity and nuance that is missed by an AI model or person - the world is just super detailed. The more expertise you have the more you will be aware of that nuance. That doesn't mean the model or person is not useful as a starting point.
- sbarre 4mo ago> Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading Yes, this is exactly so. AI is able to confidently sound plausible enough to convince laypersons or anyone who isn't very familiar with the subject matter, which is a big part of the mass-appeal "magic" of ChatGPT and other similar tools. It's like having a know-it-all friend (who also makes shit up to bridge their own knowledge gaps). In many non-advanced non-specialized situations, AI is right enough to be at best useful or at worst not harmful (usually landing in the middle somewhere). But speaking for myself, in areas where I consider myself quite proficient, I can very easily spot the subtle inconsistencies and naive conclusions that AI responses provide, and I have to guide/steer/correct it a lot to get good results when the subject matter is complex enough.
- nlawalker 4mo ago> no one else seems to find this to be quite damning for the AI services being offered, preferring instanced to be wowed by the convenience and speed at which they can be delivered unreviewed and unproven information "Be wowed by the convenience and speed", or merely "take advantage of the mere availability"? What most people find to be damning about expert advice is that they simply can't get it anywhere, at any cost that they can afford.
- intoXbox 4mo agoRadiologists very often have to weigh up different theories, guidelines based on the symptoms. The certainty of their diagnosis is their added value, or if they don’t know they will tell you why. An AI telling you it could be X or Y because theory ABC… is the academic answer and a luxury clinicians don’t have. AI doesn’t give you what you want. I don’t see any added value in using generic AI models for this
- neilv 4mo agoThis could be a starting point for consulting a different human expert for a second opinion (e.g., specific questions to ask about), but I wouldn't put much trust in Claude alone on this. IME, on an almost daily basis, claude.ai and Claude Code are confidently wrong about something, and use polished language to assert nonsense.[*] If it's doing that on something easy, like factual knowledge available in text on the Internet, or programming code that can be inspected easily and follows well-known rules, and I can tell, because I understand those things... then there's no way I'm going to assume that Claude doesn't also BS when it comes to someone else's field. Especially not a field that requires some of the smartest people to go a decade of training, just to get started in the field. [*] And if I confront Claude with its mistakes, eventually it apologizes, and acts as if it's learned something, again mimicking word patterns it's heard real people use and mean, without meaning any of it. I wonder whether the AI user experience would be better, if LLM-ish interfaces weren't implicitly created in the image of fake-it-till-you-make-it overconfident performative sociopathic techbros.
- hansmayer 4mo ago[dead]
- jeswin 4mo agoI would not trust AI on images. But I once had ChatGPT tell me that an MRI report was very likely to be incorrect based on the text, and offered a different diagnosis. Since it was semi insisting, I visited another doctor who made me do a retest. Long story short, ChatGPT was correct. Again, this is just one single person's experience. So not worth much.
- nostrebored 4mo agoI think that much of the visual gap is because what to attend to in images is less structured. Anecdotally small qwen finetunes (ie less than 10B) take task accuracy from sub 30% on FMs to 90%. We have sold some of these for outcome based back office tasks. I think we’ll see a lot of specialized VLMs that provide real value.
- energy123 4mo agoAnecdote but I gave Gemini Pro an image of an individual with Herpes Zoster which the doctor said was something else. Gemini gave the correct diagnosis which allowed for correct treatment and cure. I don't understand why doctors don't prompt LLMs before saying wrong things. Is it ego? I can understand for radiology because you need a specialized convolutional network, but for more knowledge based things...
- alwa 4mo ago“A man with a watch knows the time; a man with two watches is never sure.” I imagine reasons for what you’re asking might include: * Prompting an LLM is work, and they’re already overworked just doctoring—every conversation with a computer is a conversation you’re not having with a patient; * They’re probably right more often than they’re wrong; * “When you hear hooves, think horses, not zebras”: the 15th case today of strep throat is probably strep throat, regardless of today’s 15th falsely-confident LLM weighing-up; * They tend to have spent many many years honing a clinical intuition that makes an examination, to some degree, hard to articulate fully to the LLM; * Liability/overdiagnosis: All this stuff is probabilistic. Inevitably, there’s going to be a time when the LLM throws out something I thought unlikely that turns out to be right, and there will be other times when it’s wrong but now I have to document why. How many false leads do I need to chase per one true differential? Does this really compare favorably to seeking a second opinion from another human doctor? * Not everything needs to make it into the record. Once it’s in the LLM, it’s discoverable and litigable and hackable and permanent; * Medicine is practiced in very different ways in different contexts—even in this thread, one radiologist routinely orders ultrasounds for soft tissue shoulder problems, and the other medical-world person replying has never heard of such a thing—presumably both within US health care contexts. Some doctors hand out antibiotics like candy, others are more cautious with respect to resistance. What’s right can depend on the time, the place, the clinical setting—more than just the immediate patient-level facts at hand, in ways that become awkward or unwise to express explicitly. And of course… who’s to say they don’t do LLM-assisted research, in cases where they think it might be helpful?
- mistic92 4mo agoI have used Gemini 3.1 Pro through CLI to analyze my DICOM images. It gave me the same diagnosis as radiologists. But it was just interesting test
- simianwords 4mo agoEveryone talking about how doctors know better or have some context that is not shown here. But are you all forgetting that they literally injected a homeopathic drug on the author? Between that and Claude sometimes hallucinating, it’s probably worth encouraging patients to take second opinion always.
- sxg 4mo ago> But are you all forgetting that they literally injected a homeopathic drug on the author? I'm no fan of pseudoscience either, but this is where things get blurry. The placebo effect is real even if patients are aware of it. If you give a patient a homeopathic drug while informing them of potential side effects (if any), and then they feel better, have you hurt them? Or have you helped them? I personally have no interest in trying homeopathic medicines, but the reality is that many patients do take these and are adamant they help. As long as any risks are communicated and there are no serious side effects, it's difficult to make an argument against their use in patients who report a subjective benefit.
- ashikns 4mo agoThis is relying on the patient being stupid. I would always prefer just an honest explanation of things rather than pseudo-science drugs. And if I do discover that it's a pseudo-science drug then I've lost all confidence in that doctor. Doctors should stop pretending that they have access to some divine knowledge and everyone else is stupid. And this interpretation is charitable, assuming that they wanted the patient to feel better via placebo. A different (and more likely) interpretation being they just wanted to charge for something extra.
- late2part 4mo agoIf you have 2 clocks you have none.
- mcapodici 4mo agoOr you have an interval?
- jochem9 4mo agoRight now the article reads as "AI can play doctor if you give MRI scans". If the author would actually go for a second opinion (maybe bring along the AI to let it explain it's findings), then the article could read as "AI did MRI analysis and proved my doctor wrong" (or: "AI did MRI analysis and failed").
- VladVladikoff 4mo agoHey OP my wife had a subscap tear and went through with surgery. Recovery was ROUGH, she couldn’t use that arm at all for almost two months. It’s amazing how much this can cripple a person, we don’t realize how much we use both our hands for our daily lives until one is gone. Even basic stuff like cooking, bathing, etc. If you can avoid surgery you should. Try doing the Buckburger 12 (spelling?) shoulder physiotherapy regiment. You’ll need to even if you get surgery, but this can help with tedonopathy. Also try to identify what is causing the repetitive stress and cut back on that activity.
- busymom0 4mo agoI do powerlifting and couple years ago, I developed bicep tendinitis on my right arm. Even a tiny bit of weight on it while palm facing up would cause crazy pain. It was funny how I weight from lifting heavy weights to not even being able to carry a plate of food, not being able to press soap dispensers, or give a spot to someone at the gym. Even a tiny injury can severely cripple us.
- dwd 4mo agoSame, sprained my wrist/forearm a while back and couldn't rotate it without pain or take any weight palm up. Couldn't even rotate a door knob. It wasn't until I pushed through with weights, avoiding any underhand grips or rotation, that it started getting better. Doing bicep curls but keeping the thumb up strengthened the forearm to the point where I was back to the weights I was lifting and could then gradually add some rotation.
- hennell 4mo agoPersonally my favourite feature of the new ai world is not when I use it directly but it's when one of my managers uses it to try to fix a problem, then issue to me their findings and I have to defend my process to someone who understands neither my process, their suggested solution nor often the problem they're solving in the first place.
- willsmith72 4mo agoTrue, but this was a problem long before AI (read this article, met this guy at a conference who told me x, my boss said blah) AI probably exacerbates it but crappy managers exist regardless
- nitwit005 4mo agoBefore maybe you had to deal with someone hiring schetchy consultants once in a while, but now the managers have a limitless well of dubious answers to draw on at any time.
- darkwater 4mo agoBut now you have a new tool in the upmanagement toolbox: subtlely tell them to implement their idea in prod with Claude Code, and see it for themselves.
- VeninVidiaVicii 4mo agoYeah dealing with this now, where my CTO is shipping features that are producing plausible results but just wrong. So, now I gotta spend all day explaining the math behind certain features to her, and she copies and pastes it to Claude.
- cube00 4mo agoIt gets worse when they challenge your solutions by feeding it back into the LLM and sending the response on to you, arguing with an LLM is exhausting, arguing by proxy with a human parroting its responses is excruciating. On the plus side when they do this they can't flood your calendar with those "quick chat" meetings because they know they won't be able to hold a conversation on the issue beyond the first minute.
- eqvinox 4mo ago> My hope is that in a couple of model generations, we'll trust AI to review MRIs the way we trust it to proofread our emails. https://www.nature.com/articles/d41586-026-01947-1 https://www.nature.com/articles/d41586-026-01947-1 I've started asking my doctors whether they use AI, and if they say yes look for another one.
- throwatdem12311 4mo agoI don’t even trust AI to proofread my emails.
- rmbyrro 4mo agoThat study seems to be confounding factors and rushing to a questionable conclusion. A very plausible explanation for the adenoma detection rate to have gone down is simply that its prevalence went down among the population in the second three-month period. This was not a randomized trial. Concluding that "AI usage degrades physicians' skills" is questionable at the very least.
- eqvinox 4mo agoThere's a whole bunch of other studies on this topic, as well as metastudies, and from what I can tell the problem is real. https://www.sciencedirect.com/science/article/pii/S2451958826001764 https://www.sciencedirect.com/science/article/pii/S245195882... (+ cf. its references)
- dazhbog 4mo agoYou should always be getting a second or third opinion from real doctors for matters like surgeries, radiology, etc. One doctor diagnosis + LLM is gonna throw you off. You need more datapoints.
- ChrisMarshallNY 4mo agoIn the US, this is standard advice. I note that the OP is in Germany. Maybe they do things differently, there.
- Aurornis 4mo agoThe OP describes getting injected with a homeopathic botanical formulation and receiving another type of therapy that wasn’t indicated for his condition. I wonder if this person was going to a traditional doctor or if they were visiting some type of specialty clinic as a second opinion. For most conditions you can find specialty clinics that will prescribe and administer (and bill for) a lot of non-indicated treatments, but some patients like being in the care of doctors who take action and do things after being recommended more conservative treatments by primary doctors.
- tsss 4mo agoIn Germany we get zero-th opinion because you can't even get an appointment within the next 8 months.
- xioxox 4mo agoAnd when you meet them, if you're unlucky they don't want to hear your medical history and want you out of the door in two minutes.
- lucfranken 4mo agoWhy wouldn’t you as a doctor by standard run the images through a certified compliant LLM? The actual cost won’t be it and then you can see if you get any new ideas from it. See if it’s just wrong or that it spotted a little detail you missed? The LLM doesn’t need to be leading or whatever but then you can have a conversation with the patient. If their ChatGPT reports has differences it can be analyzed as well. It feels like the time constraint of the 15m doctor sessions is the thing. But if prepared immediately after the scan then why not? There is always time needed to factor in new developments and innovations and that’s fine. Just moving blindly work from human to LLM is wrong. But learning on and testing with all the ai tools incoming constantly won’t be a waste. There will be more and more tools in those processes outside of human judgement, better improve the workflows now to be able to test and plugin new models and systems when they are ready.
- foobarian 4mo agoI've been starting to think of LLM as a great tool for "lead generation," borrowing a term from sales. Most of the things it comes up with don't pan out, but in many cases it's things we wouldn't have thought of, or at least not as quickly. This is especially in the context of web service or SAAS outages.
- KaiserPro 4mo ago> standard run the images through a certified compliant LLM? Because they don't exist, yet. In the UK MRIs and other imaging systems need two opinions. there has been a move to allow the first opinion to be ML based. The _problem_ is that you are basically doing grey smudge analysis, and thats fucking hard.
- yread 4mo agoBecause they might bias you. And because you have your own brain, training and experience
- lucfranken 4mo agoThat does make sense but the order of it might be: doctor analysis. Then show LLM as double check to doctor. Doctor assesses and may keep en improve the doctors first analysis?
- mootothemax 4mo agoCan any LLM give you the rough pixel coordinates of an item it identifies in an image? I found that while Claude, GPT etc could describe an image, there was no way to link the description back to specific pixels in the image itself. Not even to a bounding box or segment.
- gs17 4mo agoNot as smart as modern frontier models, but Moondream and Molmo can do that sort of thing.
- davikr 4mo agoYou can try sending basic chest radiographs to GPT and it'll fail at interpretation. I'd be wary of premature conclusions.
- LogicFailsMe 4mo agoI did the same exercise here with medical reports and CT scans for a friend's cancer diagnosis and I got ahead of the oncologists predicting they were about to be cured. Spoilers: yep, cancer free now. And well, yes, I have the appropriate life science degrees to navigate clinical trial reports and research publications, and that was likely indispensable for steering Claude Code where it went, the radiologist's caution is merited here. But it's just not amateur hour for me to do this, it's 2 decades of academic research in my rearview mirror.
- linsomniac 4mo ago~2 years ago I used ChatGPT "deep research" to investigate a chronic sinus infection I'd been fighting for ~3 years. After seeing 3 GPs and 3 visits with an ENT, I fed all the observations I had into the AI. In particular, I couldn't get the ENT to explain why he visually saw, via a scope, evidence of allergic reaction in my sinuses, but then later concluded, after an allergy test, that it couldn't be treated via allergy medication. I asked this question a few times and he just never answered. ChatGPT surfaced a NIH study that concluded that 20% of people have allergic reactions that are isolated to a body location, and that shoulder "skin prick" testing may not reveal. I asked him about that and he said "that's not how allergies work". Full stop. He was unwilling to even look at the study. He prescribed a CPAP and regular nebulizer treatments. Side story: the CPAP place sent me a SMS message that I couldn't recognize was not a phishing attempt, and when I reached out to inquire who they were they never replied. So I decided: Let me just try taking a second-gen allergy tablet every day and see what happens. My sinus infections have gone away. Previously I was getting a major sinus infection at least quarterly. Maybe he's right that allergies don't work that way, but allergy tablets have absolutely solved my problem. Which I'm thankful for because I tried a CPAP for a solid month a few years ago and I just could not get used to it, and was sleeping like crap.
- nostrebored 4mo agoDaily allergy tablets are associated with huge increases in early onset Alzheimer’s. Glad you found something that works, but might be good to get some of the allergen injections :)
- tnchr 4mo agoI believe it depends on which ones, the older gen or certain classes of antihistamines
- cenamus 4mo agoWhere are getting that from? All I can find is about 1st gen antihistamines (i.e. Benadryl, which I doubt many people take daily, because of the drowsiness). Even for those, evidence seems to be mixed at best. "Huge increases" seems like hyperbole.
- darepublic 4mo agoI would like if we could have a site where you submit your MRI then doctor commenters anonymously post their opinion. In general I want a forum where.. when people come with questions for which there are varying opinions we don't just have people leave their 2c and then jet. The thread persists, duplicated ideas get merged, erroneous statements get purged and gradually we refine shining truth
- terzioglubaris 4mo agoHey, glad you did that , I have done the exact same think last week but the radiologist interpretation and claudes interpretation was pretty much the same ! you want my doctors number ? lol
- nostrebored 4mo agoI don’t understand the negative reactions. Medical care as it exists requires the doctor and patient to have their brains switched on. I’ve almost never had a problem where a doctor provides me with a diagnosis and I go about my day. Most of the times that I have, I’ve been confident about the problem and known what I needed. The doctor was a barrier to accessing care. Dr. GPT is a good brainstorming tool. It helps synthesize information in a way that primary texts don’t. But it does force you to say “that doesn’t make sense”. I do think that people saying “doctors don’t know the state of the art” have a weaker case. If you think about it in terms of token density during pretraining and how post training datasets are constructed, I think it would take us a very long time to adapt to any fundamental shifts. If we have forgotten how to cure scurvy, how many journal articles would it take before we adapt to a discovery?
- StefanBatory 4mo ago> I do think that people saying “doctors don’t know the state of the art” have a weaker case. This is kinda the case though. In Poland I met only one psychiatrist that knew about DSM-5. In this year. DSM-5 was a thing from 2013. Doctors are people just as us, not every single of them is good.
- bonesss 4mo agoMany DSM-5 diagnosis come into effect with the ICD-11, ICD-10 doesn't have a good deal of them, and that rollout is still fresh & ongoing. It is kinda spooky, though, to have freshly minted doctors from a few years back whose school-knowledge will forever be "outdated and archaic" based on standards published before they were in school. Some good advice I got: treat this as a generation shift, find younger and newer doctors who are familiar with the "modern" standards.
- junofan 4mo agoAPA guidelines come with expiration dates [1]. 10 years is the maximum. Churn is built in to the specialty. Read into that what you will. [1]: https://www.apa.org/practice/guidelines/criteria?item=5 https://www.apa.org/practice/guidelines/criteria?item=5
- throwforfeds 4mo agoI've seen a lot of friends and family members almost immediately get offered surgery for shoulder pain. It's just often the default for people that do surgeries for a living. I also had a pretty painful shoulder issue at one point, where the pain just wasn't subsiding for months. I tried massages and acupuncture as I didn't want to do surgery, but it wasn't helping at all. The thing that fixed it for me was just really focusing on doing pull-ups. I couldn't do them at all when I started, so I began with dead hangs and scapular pull-ups, eventually progressing to regular pull-ups, and then training with a "grease-the-groove" method once I could get a few per set. I stopped the training schedule once I was getting in around 17 pull-ups per set, and now just do 6 sets of about 7-8 pullups 3x per week spaced throughout the day. I'll also do some shoulder mobility drills [1]. Whenever I get lazy about keeping up with them inevitably discomfort will start arising again, but it goes away once I get back to strengthening. [1] https://www.youtube.com/watch?v=vP8YmmRMz6I https://www.youtube.com/watch?v=vP8YmmRMz6I
- alistairSH 4mo agoOn the flip side, when I had rotator cuff issues, the surgeon recommended months of physiotherapy before resorting to the knife. And it worked. And by weight training regularly with a focus on correct shoulder movement, the pain stays away. It really seems like if you, as a patient, go looking for a quick fix, that’s what you’ll be offered. And if you educate yourself a bit and then go t for the best fix for you, you usually get they.
- huhtenberg 4mo agoWhat did you have exactly? With calcifications, physio without the shockwave component definitely doesn't allow going back to the normal gym routine. It's just not enough.
- alistairSH 4mo agoGarden variety inflammation with some minor tearing, exacerbated by weakness/instability. Strengthening with PT kept the joint stable enough to stop rubbing and allow the inflammation to clear. And as long as I stick to a regular gym routine that includes rotator cuff work, it doesn’t recur (and did the few times I lapsed). But absolutely, PT doesn’t fix everything. Bit for a lot of things, it’s worth trying - but it might also means a lifetime of altered habits to keep whatever injury/problem from recurring.
- quacked 4mo agoThe thing that annoys me about AI discourse is that AI is a mathematical technique of rapidly increasing efficacy, and yet everyone personifies it. It would help if every time someone said "AI" they supplemented "a mathematical method where extensions onto a very large corpus of information are statistically simulated". It's not true that "AI makes mistakes" or "ChatGPT is sycophantic". It's just that sometimes the simulated extensions to the training material are accurate, and sometimes they're not.
- hawkice 4mo agoI think this draws too strong a line between the matrix-math core and the harness that uses it. Those harnesses undoubtedly were built with purpose and the systems fail to achieve that goal. Common usage says the the DMV can make mistakes, like any systems, despite the DMV itself not being a person (and it is common to allege large organizations make mistakes even when no specific individual is making an identifiable mistake). This isn't person-language it's systems/purpose-language.
- quacked 4mo agoI understand and somewhat agree with your point, and might have phrased my comment differently. I think my main point is that experts aren't always going to beat "a dynamically simulated extension onto the training material". Often they will, maybe even usually, but sometimes they won't, and I feel like the people in this thread insisting that the experts will always know better are thinking about a competition between experts and a crazy robot instead of a competition between experts and math.
- Kapura 4mo agoI asked a bird about my father's potential prostate cancer. It gave extremely good advice.
- rasmus1610 4mo agoAs a radiologist I have found Claude and ChatGPT to be absolutely terrible at MRI and I would not trust it one bit. It has its merits if you need to research stuff that is more text based, but radiological images is just something that they cannot interpret good enough (yet)
- lostlogin 4mo agoAI makes up for its poor reporting by enhancing the images. Current Siemens MR software ‘Deep Resolve’ makes up the signal (adding about 50%), then makes up every second pixel, and then, for 3D sequences, makes up every second slice. It’s locking about 59% of the time off each sequences. And it’s really really good. I’m an MR tech.
- microgpt 4mo agoSorry? You use AI to hallucinate medical images and that's good?
- uecker 4mo agoIt is not really the same as LLMs. I wouldn't call it AI. And I wouldn't say "makes up". I work in this field and this is certainly based also in part on my research.
- lostlogin 4mo ago‘Makes up’ is inaccurate for sure. But it’s not strictly true to call it acquired data either. After years of collecting artifacts and errors, I have more and more respect for the tool. But it’s jarring. I open a sequence, decrease the acquired resolution, add the AI and get a scan that’s quicker and higher resolution. It’s an amazing time to be an MR tech.
- uecker 4mo agoIt is amazing. It is the result of two decades of research in image reconstruction algorithms. The machine learning is part of it, but that it is sold as "AI" has probably more to do with marketing.
- AceJohnny2 4mo ago> There's something incredibly peaceful about being in the hands of an expert you trust. [...] AI can absolutely shatter that feeling in an uncomfortable way [...] but I don't know if I can fully trust AI either. This really is key. We know we can't trust the AI, but at the same time we're also more comfortable asking the AI for clarifications or confronting it. Not having a time-bound appointment or paying by the hour helps a lot. But even then, more information doesn't necessarily help! I once brought my 11-year-old car, a Civic with 150k miles, to multiple garages. I figured I'd play the "second opinion" game to correlate what the garages recommended to decide on what needed to be done... I got 3 completely unrelated recommendations, including one that I knew was invalid! I felt worse off than when I started! The solution to uncertain information isn't more information, which the AI can certainly provide, it's better information, and AI cannot currently provide that.
- 010101010101 4mo ago> The solution to uncertain information isn't more information, which the AI can certainly provide, it's better information, and AI cannot currently provide that. I'd argue that AI _can_ currently provide that, but that it can't do it _reliably_, and that to non-experts it's impossible to differentiate, which makes it all the more dangerous.
- margorczynski 4mo agoIsn't that the case with human "experts"? If you had encounters with doctors, mechanics, etc. you'll know you can get a completely different diagnosis for the same problem which obviously means (in most cases) that the person you thought an expert is wrong. What is needed are studies that will take a cold look at the actual results because AI seems to be required to be perfect or it is useless. It just needs to be as good as a human for most stuff, but in the long run it will be much better. At least that what extrapolating current reality shows us.
- wwweston 4mo agoWe have systems around humans that exist to manage expertise gaps, credibility signals, and accountability. This is part of what makes humans as good as they are, along with specialized training and some measure of meritocratic selection. We license and regulate and account and litigate to make a system that responds and improves. Some of this might be applicable to LLMs, but some isn’t and much of it would be resisted. This is one reason we’re not likely to get “as good as a human” because at some level we’re not optimizing for the outcomes; we’re optimizing for speed, convenience, some participant’s economics, and underlying beliefs.
- rainydesert 4mo ago[flagged]
- loadcurve 4mo ago[flagged]
- hectdev 4mo agoMy only issue with this was the restriction of "Do not look at any data outside of our working folder" is preventing the tool from doing what it does best. I would have given it access to PubMed to pull the latest research on the subject and validate. I wouldn't consider Claude itself to be the tool that does a job like this, but the tool that pulls in the best data and gives a supported suggestion. And then go through a number of iterations on where it failed to hone in its assessment.
- cityofdelusion 4mo agoIts very interesting how people trust LLMs in domains they know little about. Instead, it is my experiences with LLMs in a domain that I know very well that makes me skeptical of their performance across the board. I find issues in code review multiple times a day with their output, and they are explicitly and extensively trained on this use-case, unlike with the MRI data. Sometimes I veer into other domains I have decent knowledge about (construction, carpentry, landscaping) and LLMs disappoint me there as well. I suppose Gell-Mann amnesia is a universal human quirk and not restricted to just the news.
- lutusp 4mo ago> There's something incredibly peaceful about being in the hands of an expert you trust. You don't have to worry anymore and can let them guide you through the process. > AI can absolutely shatter that feeling in an uncomfortable way ... I see this as a field report in a time of fundamental transition, from a world without AI, to one that accommodates/incorporates AI. For this to happen, AI will need to become more trustworthy. As for the U.S. medical system, it can't get much worse. I recently had a similar experience (meaning walking a fence between old and new methods), where I was told I could get an appointment with a human medical practitioner in nine months. So, to resolve my anxiety I consulted AI and got an instant diagnosis, one that was later confirmed by the inaccessible medics. Being a born skeptic I wasn't going to act on AI's diagnosis, I just wanted to know what was going on, resolve some uncertainty. Another advantage: an AI chatbot doesn't say, "Wait, you're on Medicare? Hmm. See you in nine months." Don't take this as an endorsement of AI's diagnostic abilities -- it's way too soon for that. In my case it was a slam dunk, about a condition I knew nothing about.
- dwa3592 4mo agoWas it 2016 when Geoff hinton said that radiology was a dead career? Well, we now have the best model of our time (trillions of $$$ of investments) telling us something completely different(and wrong) from a human expert. I would really like someone calling out dario, sam, elon on these things and hear their explanations but alas, a man can only dream.
- nicman23 4mo agoyeah that is why you would not use a random llm that is not trained in radiology lmfao diffusion models are probably a better bet for identifying irregular structures
- tarellel 4mo agoIt’s an odd field, obviously it’s in high demand for diagnostics and anytime you have to do an xray, MRI, etc you have to wait hours for one to become available. I think they’re artificially stunting the field to raise their wages. For example in my city the medical school only accepts 11 people into the program a year. (With an average graduation rate or 3-5). My niece has been trying for 2 years and finally got in this last year. Even radiology is doing AI assisted diagnostics. Half my MRI’s from this year has Doctor notes and HealthBot (AI) notes attached to them. ~ I’m assuming other schools severely limit their radiology admissions as well. To keep the wages high and the field desirable.
- calvinmorrison 4mo agofree market solution is just order an x-ray machine from alibaba and setup shop. you could add a credit card swiper + ID + facial recognition to plausibly avoid over-xraying people These days Xray machines - they don't even suit up in lead or stand behind a wall , just point and shoot. In fact they're nice and portable. I wish i had a xray machine at home.
- aix1 4mo agoAnd, to save on combined shipping, a cobalt-60 machine to zap the odd tumour? :)
- Gareth321 4mo agoI have had terrible experiences with medical professionals. Especially the experienced/senior/specialists. First, they just don't have the time to do a thorough research of my medical history. Second, they are often arrogant and resistant to any kind of critical questions. They have an apparently unwavering belief that they are correct. In fairness, they probably usually are, but they are not infallible, and they are at their weakest when it comes to the edge cases. AI is completely without ego, and can process all my medical records in minutes. In truth, even today, I would rather have an AI analyse my records.
- idopmstuff 4mo ago> It might seem obvious to coders, but the difference between Claude Code and Claude.ai's chat is enormous, even if those two run the same model. In my experience, Claude Code is vastly better for doing tasks, writing code, etc., but Claude.ai is better for analysis and high-level planning. When I'm working on a new project, I've started using the latter to do the initial planning, get feedback and draw up a spec, which then goes to Claude Code. For this project, I probably would've done something similar - use CC to get whatever you need out of the image files, but have Claude.ai do the actual review/diagnosing. Either way, I often think about how far behind most of the world is in really understanding AI. The overwhelming majority of people would never guess that you get vastly different outcomes from the exact same model in a different harness (tbf most people don't know what a harness is). I spend hours every day using AI for a broad range of tasks and still feel like I know a fraction of what there is to know. I haven't even tried the new GLM model (or really any of the open source Chinese ones of the most recent generation). With so many people thinking that the free version of ChatGPT is SOTA AI, a lot of folks are in for a very rude awakening at some point soon.
- deleted 4mo ago[deleted]
- lycos 4mo agoI'm surprised about the 266 MB of DICOM images, I've never had an MRI but my CT results are generally between 1-2GB (zipped) and I always assumed an MRI would have more data, guess I was wrong about that!
- anigbrowl 4mo agoI use LLMs every day and value the benefits they offer, but this approach seems misguided. A smarter way to use them would be to consult the LLM before seeing the specialist and ask it to bring you up to speed on capabilities/limitations and develop a list of important questions to ask.
- gaolei8888 4mo agoI have already done that several times, and I found the comments from ChatGTP/Claude, is absolutely bullshit.
- bryanrasmussen 4mo agoI am reminded of the old saying that anyone who diagnoses themselves has a fool for a doctor,
- tsoukase 4mo agoMedical opinion will remain one of the last frontiers of LLMs. There so many critical factors that are inappropriate for them. They cannot perform a clinical exam, they have to collect the needed exams and most importantly a life might be at stake (OK, you cannot die from a shoulder problem but you can become handicapped forever). All that said, as a doctor I am totally open and even happy when a patient refers they took advice from AI. I explain the holes of their reasoning and integrate it with mine. It helps rather than hurts the patient-doctor connection.
- fuomag9 4mo agoI wish you were my doctor!
- chasebank 4mo agoDo you think you would ever use LLMs in tandem in your practice to help diagnose and treat?
- tsoukase 4mo agoI often ask, usually Gemini, at a medium abstraction level (not general What the diagnosis is, neither specific like What this high serum Ca means). The answers are correct but not enough and ready for consumption without doctor guidance. A cardiologist friend goes in deep discussions with a specialised model and he is amazed.
- Aurornis 4mo ago> They injected me with Traumeel, which is registered in Germany as a homeopathic medicine "without a therapeutic indication". This single sentence provides a huge clue about what’s going on: This person’s medical team is not good. It’s not hard to get an LLM to perform better than a team that is injecting homeopathic botanical formulations and performing procedures that aren’t indicated for the condition. I think the real takeaway from this article shouldn’t be “ChatGPT is better than doctors”. It’s a story about LLMs identifying that someone was not in good hands.
- zer00eyz 4mo ago> I won't go into the details, but he suggested I get an MRI, which the clinic conveniently had available. And > They performed shockwave therapy on my shoulder (a procedure that may not be effective, but is unlikely to cause any harm) Its not just about LLM's being better, its about people not trusting DR any more: https://www.physiciansweekly.com/post/the-erosion-of-trust-in-healthcare-restoring-the-patient-physician-relationship https://www.physiciansweekly.com/post/the-erosion-of-trust-i... If we want to fault the article for anything it's that he didnt take that information and go get a 2nd opinion from someone who IS more informed.
- Groxx 4mo agoAny medical-field-position that recommends homeopathic stuff is instantly in my "full of shit and not trustworthy on anything" list, and I'd go elsewhere immediately and file complaints anywhere I could. There's no excuse at all, they're either fools or scammers, and I want neither anywhere near my (or anyone else's) health. That said, while I do see homeopathic stuff with that name, it's worth verifying that it isn't just a naming conflict. They're not always unique, particularly across countries, and Traumeel seems to be more of a brand than a specific thing.
- ashikns 4mo agoI am confused why none of the experts weighing in here address this at all. Like I get that AI is generally disliked, but ignoring facts only makes me want to not trust doctors.
- zephen 4mo ago> There's something incredibly peaceful about being in the hands of an expert you trust. I want to know if this is a religious thing, or is related to never having had multiple doctors so bad it seemed like they were actively trying to kill you, or both. I've never had this peaceful experience personally within the realm of healthcare. > AI can absolutely shatter that feeling in an uncomfortable way Good. Reality is always good. > but I don't know if I can fully trust AI either. WTF??!? Why on earth would anybody ever think they could fully trust LLMs? Even their most vocal proponents concede they aren't infallible panaceas.
- iluvcommunism 4mo ago[dead]
- tibbydudeza 4mo agoI would trust a doctor with decades of experience and his diagnosis and treatment plan than some LLM. It like using WebMD for any ache and pain and it is saying it might either be Lupus or cancer.
- paul7986 4mo agoWent to a new dentist recently and his staff took x-rays of my teeth. I was then waiting for him to come speak with me about what the x-rays show him yet i just took a pic and uploaded it to Gemini. 9 months back my previous dentist said i should have a filling or potentially a crown was needed. I told Gemini this and that ive only about 3 fleeting pain issues in that area. With the x-ray and that info Gemini told me the exact same thing the dentist later came in and told me. If pain comes back and for long periods of time then there's an issue as the x-rays look fine. Overall i see a great opportunity for x-ray techs (radiographers even when Jensen from NVidia says the first field he recommends not getting into - Radiology which is the step above) to open their own businesses for people who want to use AI for self care and help. Have one doctor or dentist on staff to use as needed.
- algoth1 4mo agoI love how the doctors injected basically water. I imagine the doctor thinking "we did all we could"
- YuechenLi 4mo agoYeah, one of the big problems with that is that Claude/ChatGPT doesn't perceive images the way humans do at all, so when you upload an image to them, it gets tokenized in some form. This is why most LLMs are really, really bad at spatial recognition for image editing purposes for example. So, unless you can turn the image into a natively tokenized format like JSON or something that somehow accurately tokenizes what's on there, I would NOT trust Dr. Claude's analysis. If you want a second opinion, talk to another doctor. A human doctor.
- KerrAvon 4mo agoGiven the tenor of the comments on this article, I think reading TFA is super important, especially the author's disclaimer at the end, where they state that they're definitely not blindly trusting the AI at this stage, just that they find the differential unsettling.
- yaroslavvb 4mo agoI had similar experience, Claude made report of MRI for achilles tear, it measured the gap, but it was completely hallucinated. Achilles tendon is black on the MRI, it instead measured 13mm distance between two completely different things (looked white), the radiologist looked at and saw no gap at all
- chpatrick 4mo agoI recently had a pretty bad injury and out of curiosity I asked Gemini what it thought based on some CT scan slice images (and no other information). Surprisingly it came to exactly the same diagnosis and treatment plan as my doctors, but the big advantage is that I could ask it follow up questions any time, whereas the doctors barely explained anything.
- dwd 4mo agoThis... Gemini will ask for the specific images it needs to see and show you examples of what each slice will look like. But unlike the specialists who often come across as abrupt and rush you, Gemini will happily take you on a deep dive and continue to answer all you follow up questions indefinitely.
- motbus3 4mo agoThe only part of the message I think it would be interesting to the author: what if you set two instances to prove each other arguments wrong considering that each reads one of the report as their POV? I didnt see the full process but I used unet models for tumor detection so I am somewhat familiar with the possible caveats of any evaluation from a engineer perspective. First, I would like to point that unfortunately, it is not uncommon to go to two different human doctors and also get two unreliable diagnosis and treatment. The biggest problem, in the way people plan to use ai on health is the lack of liability. A bug on a regular old web site doesn't kill anyway nor cause pain and suffering (most of the times) but misdiagnosis + the fact that a model is very good on presenting arguments even when it is completely wrong. Claude code, and I am talking about opus 4.8 here, can tell rivers of information about code pattern and develop the poopiest code the next line. This is a machine that will deliver a sort of templates document based on the input information but it is not exactly doing the work if you don't directly it to do it right constantly. Because the model isn't thinking I wonder what happens if you set multiple agents to communicate and defend their point with some sort of harsh penalty prompt for not fulfilling its goal. There are some safety system prompts on Claude models that will trigger it to be very carefully to write. Like: you cannot make mistakes. "You need to ensure that it is correct or someone might end up hurt or even dead" But you would need two agents and a setup to communicate via pipes or files.
- matsemann 4mo agoI tried the same on images of disks in my back. The ai picked a slice not from the middle and used that to say they were too small (since it was looking at a slice towards the edge) and basically told me my life was over and my pain would last forever. Luckily my disks were fine. Wouldn't trust it. Additionally, an MRI of a pain-free, healthy human still would show lots of things and damage. Unless it coincides with a symptom, it's probably harmless. That's why the history is important when looking at images. Can't just upload something and hope for findings.
- twodave 4mo agoAI use is such a polarizing topic anymore. What ever happened to just waiting and seeing how it all plays out? Since probably none of us is going to be able to predict it anyway.
- quarkcarbon279 4mo agoAs a developer I have many times seen Claude's models confidently hallucinate, jump into conclusion. Fable though I used just for 2 days, didn't experience it much in the short-term.
- piterrro 4mo agoIt funny to see the community here expects the human body to be treated like a deterministic function: for input X expect output Y - and that transfers to diagnosis - people expect to receive the same diagnosis from different specialists for the same issue. Given human body complexity, the diagnosis is a compound output of the experience, knowledge gained throughout the career and diagnosis methods/equipment, the title (like Dr) is a certification imposed by the state so its "safe" to let people practice since they passed "the bar" - but that doesn't imply everyone will be treating the same. Some specialists update their knowledge monthly, some yearly and some don't do it at all, there are so many variables in play here (geo, politics, even weather haha). Having said that, choosing the specialist is really important, getting opinions about their practice and their speciality, you can only maximize your chance of getting the right diagnosis, but don't expect to get it right just because somebody is called a Dr.
- b800h 4mo agoI'm not sure what your point is. Are you saying that medicine is inherently fallible and therefore AI is more likely to make a good diagnosis - particularly a cluster of specialist AIs?
- mrlongroots 4mo agoYeah I think the OP is muddling the point by conflating "physician's version of the diagnosis" with "The Diagnosis". There is absolutely one "The Diagnosis". Human body is a machine, albeit a very complex one, and all measurement sources have noise. But they are all measuring one reality, and if there is a problem, there should be one explanation that all measurements align with. They can be noisy but can never be conflicting (instrument error notwithstanding). Physicians' ability to arrive at "The Diagnosis" would vary, but it does not mean one does not exist. I am not sure if characterizing human body as derministic or not is relevant here.
- piterrro 4mo agoI think „the diagnosis” is over simplification and lots of professionals would disagree that there’s always a single one. As a patient your goal is to eliminate the symptoms of whatever is going on in your system. Often times there could be many reasons for it and only curing one can help you already. The diagnosis is a help tool to choose the roght curation method. Thus, chasing the „right” diagnosis (whatever that is?) is pointless, as it only the outcome (reducing symptoms, stopping the damage) can tell you if the diagnosis was right, but not the only one right.
- chasebank 4mo agoAnecdote on healthcare, adjacent to this. My dog had been acting off. Wouldn’t eat, was hunched over, looked sad. We took him to a local vet who did an X-ray because they suspected a blockage. They didn’t see one, so they sent us home with standard pain meds. Randomly, we had a dinner party that night and another vet was there. She heard the story and immediately said, “Go home right now and take your dog to an emergency vet with ultrasound.” Turns out, at the time, most vets had been trained to use X-rays to look for blockages, but newer evidence showed X-rays were only something like 20% effective compared to ultrasound, which was closer to 95%. (forget percentages but somethign like that) The ultrasound found an avocado pit stuck in his intestine. He had emergency surgery that night. That chocolate chunk of an English Lab ended up living until 15, and only needed two more blockage surgeries after that... I know doctors hate patients reading the internet, and LLMs are going to make that 1000% worse for them. But hopefully over time, we all adapt together and end up better off in the long run.
- sehw 4mo agoI used my dog to clean my room.
- kgeist 4mo agoA few years ago (before the AI craze), I was misdiagnosed with tuberculosis. I had a chronic cough, and an outsourced radiologist at a clinic found signs of tuberculosis. The findings were sent to the city's tuberculosis hospital, as required by the country's law. The doctors there took the radiologist's conclusion at face value and required me to stay at their hospital for at least 8 months under a strict, prison-like regime. There was no option to say no, because I was considered some kind of biohazard, and by law I had to comply. Before I was admitted, I quickly found another radiologist, who diagnosed pneumonia instead. I sent his report to the chief doctor at the tuberculosis hospital, and after some deliberation they concluded that the original reading was wrong. Turns out the doctors there can't read scans at all and just believe whatever a radiologist says... The funny thing is, they had already officially put me on the tuberculosis register and didn't want to admit they had made a mistake. So instead, they simply gave me another paper saying that I had been cured of tuberculosis by them... in 7 days. I'm probably the only person in the country to defeat tuberculosis in a week :) So if you don't trust the radiologist/doctor, maybe find another doctor if you can afford it? You can compare their conclusions and see if they match. Two unrelated doctors or radiologists saying the same thing is probably about as close to the truth as you're going to get. I'm not sure though whether I should trust AI or humans more. AI can hallucinate, but I've been misdiagnosed by humans so many times too...
- azan_ 4mo agoHow is it possible? You can't diagnose tuberculosis just based on imaging and tuberculosis hospital has to know that!
- kgeist 4mo agoYeah, I know! It was strange. They gave me a test, and it came back negative, but they insisted it was negative because I had "latent tuberculosis," which supposedly wasn't detectable by the test yet but was about to become active. I forgot to mention that, besides getting a second opinion from another radiologist, I also took a more modern test at another private clinic. That test has better detection rates than the one the state clinic used, and it came back negative too. I have suspicions they had some kind of government quota to keep the hospital staffed with patients in order to receive funding. Or they were just completely incompetent. I pushed back by bringing them another radiologist's report and the results of a better test that I paid for myself, so I guess they decided to back down.
- geraneum 4mo ago> There's something incredibly peaceful about being in the hands of an expert you trust. You don't have to worry anymore and can let them guide you through the process. AI can absolutely shatter that feeling in an uncomfortable way It's always something along the lines of incredibly peaceful, insanely powerful, extremely interesting, also scary and uncomfortable meanwhile feel like magical super powers and science fiction. I'm telling you... words have lost meaning.
- thousandflowers 4mo ago[flagged]
- kburman 4mo ago[flagged]
- curevalue 4mo agoAs everyone knows here a large language model using probabilistic next phrase approach will not be able to "diagnose" results from an MRI - at least not with enough confidence. It lacks the patient's history and a snapshot along with very varying datapoints in the training set will lead to "approximate" results. Not what a true doctor with a 360 view of a particular patient's health would be able to diagnose. That 'approximation' will get "better" in time - which only means the results will be replaced by yet another approximation.
- light_hue_1 4mo agoGo with your report back to your doctor. A family member has cancer and we treat chatgpt as part of the team (our doctor's words). I ingest everything into it, work with it to make a good report. Then at the next visit we review it. This gives you the best of both worlds. You get peace of mind and the doctor explains why and how the agent was right or wrong. Twice now we've caught consequential mistakes (wrong pain medication and incorrect notation of the exact mutation that he has). Which have made a difference to his quality of life and treatment path. Most of what the doctors have said is in line with the agent but when there have been disagreements they've been very reasonable. Sometimes the doctors have gone with the agent's version sometimes they've explained why that's inappropriate.
- thewanderer1983 4mo agoI was diagnosed with a rare blood disease called Essential Thrombocythemia (ET) which is part of a group of diseases called myeloproliferative neoplasms. This happened about three years ago. Recently, I decided to get a second opinion and my new specialist changed my diagnosis from ET to Polycythemia Vera (PV). She also highly recommended I quickly go and give blood to lower my haematocrit levels as it put me at a much higher risk of a blood clot. This is standard practice for people with PV but not people with ET. I decided to put the details into google AI in the same way that the original specialist used to diagnose me. Google AI predicted I very likely had PV instead of ET. I also asked Google AI how one could misdiagnose my condition with ET instead of PV and google correctly explained how. My specialist had used my high platelet count and blood test that came back with a JAK2 mutation then after a bone marrow biopsy to incorrectly diagnose me with ET. My high hemoglobin levels should of been checked by my first specialist as an indication of PV not ET. Only the second specialist picked up on this. Google AI took five seconds, and is free. The specialists costs $$$ and took weeks.
- throwaway762 4mo agoInteresting. I am also diagnosed with ET (from platelet counts, pathology report noting abnormal platelet morphology, and JAK2 mutation from a marrow biopsy). What made you seek a second opinion?
- thewanderer1983 4mo agoMy original specialist wasn't very engaged with my condition. I was getting the same speech every six month visit. On my last meeting she incorrectly stated a condition I wasn't having with bleeding. My wife had a thyroid issue a number of years ago including cancer growth on it. Her first specialist was using older techniques for her treatment. We ended up going to another specialist who's focus of research was her condition. It was worlds better. Given that experience I decided to find another specialist who focused on my condition. The first specialist ( hematologist) was referred from local GP. She is a a hematologist, but she wasn't focused on MPNs. I recommend joining your local MPN alliance to keep up with what's going on in this field. I also recommend finding a specialist with a focus on MPNs. Looks at their papers or listed focus.
- j45 4mo agoImaging is one area where patients will be able to become more educated to ask better questions. The areas of premature heavy interventions can be a challenge, especially where there might be room for interpretation and the medical professional didn’t share all possible options. It’s critical to ask all professionals for all possible options and write each down as they write and explain it. No one’s perfect, and not everyone is negligent or malicious.
- anon291 4mo agoI've found ChatGPT to be much better at medicine than doctors. For example, every winter, I would get itchy toes. I was quite concerned because they could be quite painful. But the symptoms were not obvious and they wouldn't occur often. The toes would swell up and become quite red and uncomfortable. One doctor suggested gout, which was not the right diagnosis, because I have no urea problems. Others suggested a skin cream. No... I told ChatGPT exactly what I told you and it came up with the answer: Chillblains, which should have been obvious given everything I described, yet general practitioners were clueless and often reached for high intervention approaches Harmless condition fixed by wearing socks. I brought it up with the same GPs who had misdiagnosed me and none had heard of it. Of course, I'm cognizant that it could be mistaken, but a hospital fed my diabetic aunt a normal sugar diet while she was in a coma and forgot to give her metformin, so I mean, it's not like humans can't be retarded as well. The difference is no one gets offended when I point out ChatGPT has the capacity to be an idiot. Instead they just fix it.
- madrox 4mo agoI had shoulder pain about ten years ago. Had an MRI. Found evidence of a tear. Was told I would need surgery and referred to a sports medicine doctor. He looked at my MRI and said the real problem was my shoulder was frozen, and he could do surgery but the PT after is what would actually be what helped me. Two radiologists and two doctors saw my MRI before this moment. Sure enough, with a little PT I got better. I’ve had several more medical blunders since then, including a doctor telling me my problem is to lose weight 48 hours before going into emergency surgery. What I have learned is to be weary of any time I feel like I’m in a “funnel.” Once you’re in the funnel, no one is thinking critically about your issue any more. One person said they found X. Next person reads that and assumes Y and recommends Z. And so on until the alpha is multiplied to hell. Lots of treatments that don’t hurt but don’t help and run up insurance. I have since used AI the last couple years and it has either concurred with my doctors or given me enough ammo to challenge them. If I were the author, I would trust neither but use Claude to ask how to go back to that clinic and challenge the diagnosis.
- jongjong 4mo agoI don't know which country this is but this sure seems like a country where doctors have an incentive to maximize the amount/cost of treatment. I've seen the two extremes in different countries; either they have a tendency to maximize the complexity of the medical situation, or they minimize it "Don't worry, it's just stress" - I've been to different doctors in different countries and I see a pattern based on the country and the incentive structure. In some countries, they will send you off to do a scan for the slightest malaise. I don't think it's about quality/coverage of public healthcare (at least not on its own; I have not seen a clear pattern across this axis). I think the difference is to do with the referral system. In countries where you can't go directly to a specialist and need a referral from a General Practitioner/Physician first (I.e. in order to get a refund), you tend to get more false negatives from the GP which block you from going to the next stage "It's nothing, just stress-related." In countries were you have the option to go directly to a specialist, they tend to be much more trigger-happy in terms of giving you a full workup and GPs/Physicians will more easily refer you to a specialist. And I feel like the attitude extends to the specialists themselves. I suppose making people go to a GP first creates a kind of efficiency and predictability which alleviates pressure to exaggerate the severity of the situation.
- myshapeprotocol 4mo ago[flagged]
- throwawayffffas 4mo agoFucking doctor google bullshit, they want medical treatment but don't want medical advice...
- parsabg 4mo agoWe provide a second opinion service with certified human radiologists, if anyone's interested: https://expert.med https://expert.med
- coffeecoders 4mo agoI need this but for dentists.
- beacon294 4mo agoI put a MRI of my body part into Gemini 2.5 Pro (for fun) and it said it was my brain. These models don't necessarily have that data.
- GuestFAUniverse 4mo agoGerman doctors are very prone to quackery. Including their nurses. I've overheard a nurse at a university hospital argue with patient who used tape on himself about the color of the tape. She was worried he might use the "wrong color". Again: at a university hospital, where they teach MDs. Half of them recommend homeopathic remedies In short: quaks.
- skeptrune 4mo agothe more awesome thing to me is that you can run the MRI through an ensemble of LLMs and check to see if they converge among each other
- _carbyau_ 4mo agoThis seems less a demonstration of competence than of accessibility. Often we only get 10-15 minutes with the one health professional that makes a determination and sets the path of your life for some time. As opposed to being able to spend hours with an LLM that in many ways feels more sympathetic and helpful - even though it's competence is in question. So here we are: 1. with doctors processing patients every 10 minutes like a machine. 2. and machine's processing, for a patient, at any hour like a human.
- ValveFan6666 4mo ago[dead]
- hmokiguess 4mo agoNice, I have Claude, now I just need an MRI (which in some countries is sort of a hard requirement still unfortunately, long queues)
- themantalope 4mo agoRadiologist. I don’t read MR shoulder exams in my day to day practice, but from the few pictures shown , I can’t conclusively disagree with the original report. These models are generally terrible at reading medical images. The amount of public training data on the internet compared to the number of scans a radiologist reads in training is minuscule. There’s obviously a ton of medical images in general but very few, and even fewer along with a report are available on the internet publicly for download. There are vision language models coming out of research labs that are excellent in describing and localizing findings. Still at the level of a 1st or 2nd year radiology resident, but as we all say - this is the worst the models will ever be.
- make3 4mo ago[flagged]
- billynomates 4mo agoAnecdotally, I've had Claude (Sonnet and Opus latest) consistently misread numbers from screenshots of my macro tracking app. Makes me skeptical of claims about its usefulness for anything requiring accurate image interpretation, let alone MRI analysis.
- deaux 4mo agoAbsolutely. It's very unfortunate that this post used the worst example possible of using LLMs for medical purposes. General-purpose LLMs are _fantastic_ at medical diagnosis that do not involve imaging. I am completely convinced that given enough information and time, frontier models already outperform >90% of doctors on initial diagnosis of internal issues and suggesting medical tests to further reject or confirm the most likely theories. To the point where I'm eagerly waiting for the first hospital in the world that's willing to be open and honest about using them for that first step, and then proceeding from there. I'll be on a flight there as soon as one arrives. At the same time, they're worse than useless at anything involving medical imaging. Asking them to interpret them is worse than trying to interpret them yourself as a layman. And you surely wouldn't interpret them yourself.
- 4mo ago
- neves 4mo agoA coworker just spend a weekend with AI analysing his image data. No problem detected. The official diagnosis came later: he had a serious degenerative problem. These models don't have curated image exams in their training data. Your can't trust them.
- FredF--- 4mo agoThank you for sharing. I'm about to get my MRI scan on my right shoulder tomorrow. Now I'm wondering what I'm going to do even if the result shows benign. Certainly, I would double check the result if it's concerning, should I also check a comforting result in case the truth is less comforting?
- KronisLV 4mo ago> So I'm left in a state of limbo where I either try my luck with another doctor or wait and see if my shoulder gets better with the rehab I'm doing. Get a second opinion from another doctor. If that’s inconclusive, see three.
- BIackSwan 4mo agoAlthough it does not handle MRI files yet. I opensourced an AI workflow that helps in figuring out issues with my family. https://karankurani.github.io/OpenCareLoop/ https://karankurani.github.io/OpenCareLoop/ It has helped me personally solve longer chronic problems in my family that doctors just dont have the time to go into indepth due to their (understandable) lack of time. Its in alpha and AI hallucinates. Use with care. Feedback welcome. An AI agent for personalized healthcare is inevitable. The cases such as the one posted are all solvable with time. AI has hallucinated and continues to hallucinate but the value we get in the space of coding can be extended to other domains.
- AidenVennis 4mo agoPersonally I do this as well now with a lot of stuff. I've recently had a lot of issues with my knee, which was operated on about 20 years ago because of a torn cruciate ligament, and now it was acting up again. The specialized doctor did a x-ray (which I thought was pointless because I was sure it was not bones related). Long story short, my left knee is 20 years older then me because of increased knee wear and tear. I don't have a doubt the doctor is right, but I did doubt I memorized everything correctly, and later on I had some more low effort questions I didn't want to bother them with like what movements should I prevent and specifically what training I should be doing at the gym. Thankfully I got a pretty detailed report that I couldn't read because of all the medical terms. I've fed this to Claude and asked for a human readable conclusion and it repeated pretty much everything the doctor told me, which was great, I now have a readable report for future reference. Secondly I asked it questions about what movements I should and shouldn't do, and it eventually I made a gym plan to improve stability and prevent any more wear and tear in my knee. Lastly I validated this with the assigned physiotherapist, and the plan I created with Claude was perfect! I probably won't ever use AI as a second opinion, but I would definitely use it to ask numerous silly questions that would help me in day to day life.
- i4i 4mo ago"A 2026 Finnish study published in JAMA Internal Medicine that used magnetic resonance imaging (MRI) scans to look at patients’ shoulders found that 99% of Finnish adults over 40 have at least one rotator cuff abnormality." https://brainlenses.substack.com/p/abnormality https://brainlenses.substack.com/p/abnormality Incidental Rotator Cuff Abnormalities on Magnetic Resonance Imaging https://jamanetwork.com/journals/jamainternalmedicine/fullarticle/2844659 https://jamanetwork.com/journals/jamainternalmedicine/fullar...
- shiandow 4mo agoI read the article, I read the AI's verdict, I read the comments here, and I still don't know if OP does or does not have a tear in their tendon! The AI doesn't present evidence I can understand, it doesn't even present a plausible explanation why someone could conclude it is a tear. The main things that made OP suspicious are the possibly unnecessary shockwave therapy. Which seems harmless. And using a homeopathic gel that I would classify as more of a herbal medicine because it contains several ingredients I know people use for shoulder pain, and some even in concentrations that might even have an effect. If this is the best rebuttal AI can come up with I would trust the diagnosis. But then OP never trusted the diagnosis and now they have several they cannot.
- misja111 4mo agoAs someone who has had shoulder issues for the last 25 years or so, including partial tendon tears, I can tell you that even if your tendon would have been damaged, the treatment would have been strange. With moderately damaged tendons, you want: 1. stop any inflammation, by taking NSAIDs for a few days 2. detect and correct any behavioral patterns that could have caused the presumed overwear of the tendon 2. start physiotherapy to strengthen those muscles that can take over the load from the damaged tendon These are not quick fixes, because quick fixes don't exist here. Stuff like shockwave treatment, massages etc will only lessen the problems for a few hours at most, after which they will come back.
- deaux 4mo agoFrustrating post. This gives rightful ammunition to the calls of "LLMs need to be avoided for anything medical". Even though the issue is that they're asking it to interpret images. They need to be avoided for that, but that doesn't say much about their medical accuracy outside of image interpretation. It would already be a huge benefit to 90% of people worldwide if the very first part of most hospital visits would be outsourced to frontier-level LLMs. Yet this kind of misuse just gives the medical industry a stick to beat that idea into the ground. Oh well, I'm sure there will be at least a few countries that will indeed embrace frontier models for initial diagnostic medical purposes. Maybe medical tourism destinations. But it's unfortunate for those who can't afford the trip.
- jkwang 4mo ago[flagged]
- stefs 4mo ago> My hope is that in a couple of model generations, we'll trust AI to review MRIs the way we trust it to proofread our emails. the doctors may have financial motives to suggest unnecessary treatments. but i fear, by the time we'll have models powerful enough we'd be _theoretically_ able to trust their expertise, the financial motives will have shifted to the model creators.
- imdsm 4mo ago[flagged]
- ltbarcly3 4mo agoI had Claude interpret a photo of the heart monitor when I was in the ER last year. It said I was about to die. I was fine.
- petercooper 4mo agoI'm pro-AI, but when I can't even give Claude a photo of my fingers clearly on four different piano keys and get an accurate result of which keys I'm pressing, I'm bearish on its visual analyses. (With that said, I imagine it's been trained on more photos of MRI scans than people playing piano, so I could see how it might provide interesting ideas for a radiologist to consider.)
- voidUpdate 4mo agoHow do LLMs get information from images? Do they have to run essentially the opposite of an image generation model, taking an image and converting it into a description? I'm just concerned that the description wouldn't be able to encapsulate the information needed to differentiate exactly what is wrong with a shoulder. The image -> text model would need to know what it should actually report back to the LLM about the image, so that it doesn't just say "this is an MRI of a shoulder" or similar. It would be like a layperson describing a bridge, and asking an engineer if the bridge is safe based on that description
- weird-eye-issue 4mo agoNo, it does not work like that, it actually can process the image itself there is not an intermediate image to text step
- voidUpdate 4mo agoHow does a Large Language Model process images then?
- jappgar 4mo agoIt can only deal in tokens, so you're essentially right that it creates a textual description before describing it back to you. This process is obviously incredibly lossy and details are easily missed
- Mr-Frog 4mo agoolder vision LLMs chopped up images into patches which were projected into the same embedding token space as words. Newer ones use an encoder to more efficiently project an image into token space. Then it runs through the same attention layers as the text component.
- niceworkbuddy 4mo agoThis is like someone not knowing software development at all doing a code review.
- manicennui 4mo agoIf you see an orthopedic surgeon (the much more common name for this type of doctor in the US) about almost anything you will almost certainly end up with an MRI (good chance your insurance won't cover this fully) and some kind of recommended intervention.
- 1970-01-01 4mo agoSeems like we've forgotten something already? LLMs are bad with the butterfly effect by their very nature. An extremely slight phrasing change can absolutely trigger a deterministic output decision that is out of touch with reality. Tuning only helps if there is training from a previous input. As far as I know (casual research), there still isn't a great solution to this, only marketing hype.
- jedimastert 4mo agoI'm seeing surprisingly few comments about OP getting homeopathic treatment
- dsign 4mo ago> There's something incredibly peaceful about being in the hands of an expert you trust. You don't have to worry anymore and can let them guide you through the process. > AI can absolutely shatter that feeling in an uncomfortable way... As a mental experiment, think how things would look like if the AIs were right more often than doctors. Then living longer and being healthier would imply living with a lot of "technical medical worries" that you don't longer get to outsource to a black-boxy human wearing whites. I know some people who are already ridding that train.
- steele 4mo agoI wonder what this article would have concluded if the author considered how many individuals of the HN readership were professional radiologists.
- Volsk1 4mo agoI thought this was an interesting experiment and I repeated it with my own DICOM. Results are terrible. Claude has complete opposite diagnosis on my ACL, mensci and cartilage. Claude: Primary finding: Complete ACL tear with the classic pivot-shift bone bruise signature (posterior lateral femoral condyle + anterior lateral tibial plateau edema) and large hemarthrosis. PCL, MCL, LCL, menisci, and cartilage all intact. Radiologist: English translation of findings & conclusion: Mild joint effusion. No Baker's cyst. Post-ACL reconstruction with minor cyst formation in both the femoral and tibial bone tunnels. The ACL graft shows heterogeneous signal but no complete or recurrent rupture. PCL and collateral ligaments intact. The lateral meniscus appears abnormal, likely from prior partial meniscectomy, with significant cartilage loss (partly Grade 4) at the posterior lateral compartment, osteophyte formation, and reactive bone marrow edema. The medial meniscus shows diffuse signal change from prior repair but no recurrent tear (specifically no recurrent bucket-handle tear). Mild chondropathy with focal cartilage loss on the lateral side of the medial femoral condyle. Cyclops lesion present. No definite loose bodies.
- farceSpherule 4mo ago[dead]
- Maro 4mo agoRecently I was at the doctor for a very minor sports injury ("tennis leg"). The doctor — who was in his 50s — was explaining the degrees of the injury to me, and quoted ChatGPT as the source, along the lines of "ChatGPT usually says you have to rest for.." I thought it's quite funny, but after thinking about it, it's really no surprise that doctors also use AIs to look things up / clean up their diagnosis.
- order-matters 4mo agothe more I think about what intelligence really is and what it is about humans that AIs seem unable to replicate, the closer I come to the conclusion that personality is a huge component of intelligence. Certain problem spaces have a structure such that personality differences are stripped away, like in math problems for example, but more and more I am genuinely starting to believe that personality drives intelligence. There is an undeniable mechanical / logical / objective component to intelligence that acts as the machine to get answers, but I am becoming ever increasingly convinced that you cannot actually separate this machine from personality and still perform at the highest level it is capable of. Communication has its own intelligence limits, and I do not think the marketing angle of "putting intelligence on a meter for you to buy" is going to be an actual real application of intelligence. Not without also outsourcing your personality or being satisfied with a flanderized impersonator of yourself as part of the intelligence it may seem like this sort of thing should be ignorable for analyzing an MRI, that it's an objective conclusion. But medicine is not really as black and white as it seems. Doctors often have different opinions and they are credible. scans are not oracles, interpretation is involved, as well as a measurement of faith in what the patients body is able to do on its own and what it cant. hard to describe in a simple comment, but the point is that medical diagnosis are not exaclty something that can be packaged into perfect products for consumption to turn into the 1 and only treatment that's best for you
- shadowtree 4mo agoWord of caution, I used Claude to read my MRI images too. Looked legit. Until I really dug in, and found that all it did was read the embedded annotations. DICOM is a container format after all.
- kensai 4mo agoAs a neurologist I read often imaging findings myself. However, one ability of the radiologists I appreciate is their ability to discern through artifacts by years of experience. I am not convinced the current AI crop can reach this level of discerning yet. But I am pretty sure they will reach us and surpass us there as well. For the moment, I would prefer the final opinion always to be from a human (the human-in-the-loop approach in medicine). Best course of action is to run these LLM assessments and bring them to the next appointment and challenge constructively the doctor.
- pmarreck 4mo agoThe text on this is unreadable on my machine because the background immediately goes to white.
- nums 4mo agoHere's an example that illustrates a shortcoming about how medicine has historically been practiced and how it might change with the advent of AI. A person very familiar with me was having an interaction at a review board level at Stanford. They had this rare illness that they were treating and someone had the "bright idea" of suggesting of saying ... "hey, why don't we look at the ten other times we treated this exact illness and see what worked!" Everyone was delighted with this novel idea (discussion circa 2021). My person was a bit disgusted as this is simple feedback loop style improvement and WTF! they should be doing this all the time to get probabilistic style suggestions for many treatments. I know it happens within certain healthcare systems (e.g., Kaiser had full EMR back in early 2000s and saw right away that VIOXX was killing people. So, they stop prescribing it. citation: Kaiser panel member paraphrase at a healthcare conference in 2010). If you just observe the healthcare system, you can see that the healthcare systems and most EMRs don't typically capture the feedback loop (i.e, when's the last time a doctor followed up and said "did you feel better after the last treatment?" or measures the result.) AI itself can't solve this as it doesn't have access to the data feedback loop. However, maybe AI's within the EMR will help "suggest" evidence based treatments. I could go on and on, but as a math guy, I've often been shocked at the non-evidence based assertions some doctors make. My conclusion is that if you're not "in the fairway", they are typically just guessing.
- impartshadow 4mo ago[flagged]
- deleted 4mo ago[deleted]
- harhargange 4mo agoI was building a pc and the ai was hellbent on saying either the cpu pins are bent or motherboard is faulty. Both giving me a panic attack. The solution came from updating bios which i had done so ai ruled it out. But the shop owner did the bios update again and it worked
- rurban 4mo agoIf you ever get a MRI! I'd like to have one for my broken shoulder, but they decided the x-ray is good enough before my shoulder OP. At least I got a date for my shoulder OP one year after the accident. Everything's perfect in Germany.
- zftnb666 4mo agoTrusting Claude Code with my MRI before I trust it with my production database. Priorities.