7 ms·
'AI' Is Supercharging Our Broken Healthcare System's Worst Tendencies
- pixl97 3y agohttps://en.wikipedia.org/wiki/Computers_Don%27t_Argue https://en.wikipedia.org/wiki/Computers_Don%27t_Argue
- musha68k 3y agoAlso continuing the trend of unaccountability at least on a personal level. https://en.m.wikipedia.org/wiki/Skin_in_the_game_(phrase) https://en.m.wikipedia.org/wiki/Skin_in_the_game_(phrase)
- kruft 3y agoAlso also https://twitter.com/SwiftOnSecurity/status/1385565737167724545 https://twitter.com/SwiftOnSecurity/status/13855657371677245...
- satellite2 3y agoThis is not healthcare per se but insurance policy. It doesn't say anything about the use of AI in actual medicine.
- haltist 3y agoInsurance companies in America determine which patients are worth treating and which ones are unprofitable. In theory AI can enable better and cheaper treatments for everyone but that would mean insurance companies would have to start caring about something other than profits. Their main metric is profit so AI will be used to maximize profit and minimize costs just like in every other industry.
- anonzzzies 3y agoWell, they don't say medicine, they say healthcare system. That seems accurate considering your actual access to healthcare and the level of quality depends on insurance.
- falcolas 3y agoGiven how tightly integrated insurance is with what treatments Doctors are allowed to give you, it's absolutely a problem for the entire healthcare system. "Before you go on this medication that's specifically targeted at your symptoms and diagnosis, you must first try and fail these 5 other treatment methods, including a round of anti-anxiety meds and counseling."
- hotpotamus 3y agoI've actually had anti-anxiety medications relieve a whole raft of symptoms that obviously turned out to be anxiety. There are many problems with healthcare systems, but I have to say that lorazepam is really the best drug I ever took; I can see why people become dependent, so I take it quite sparingly.
- falcolas 3y agoThere's a lot that could be said about how an "anxiety" diagnosis is abused by doctors and insurance companies (especially against women), but in the end it really boils down to one thing: The medications you're taking should be a determination between you and your Doctor, and not an AI working for your insurance company.
- hotpotamus 3y agoI could probably expound quite a bit on the problems of interjecting an insurance company into healthcare, but I'd say that as a principal, I completely agree with you.
- dfxm12 3y agoThe title says "Healthcare system". Insurance is part of that.
- arolihas 3y agoInsurance policy is unfortunately a large part of healthcare in America.
- terminous 3y agoI'm sorry, did the title say "medicine"? What's your problem? If you think these kind of low effort comments are contributing to the discussion, please reconsider.
- QuarterReptile 3y agoMedical Insurance has all of the characteristics of a bad insurance business: small claims, frequent claims, horrendous adverse selection risk, and moral hazard everywhere. Undoubtedly, AI will help it reach its logical conclusion even faster.
- kelseyfrog 3y agoSadly, there is no state of malfunction that will result in the people having the ability to affect change feel compelled to affect change. With incentives or "that's just how the world works" effectively conspire against improvement.
- verdverm 3y agoagree, this is a low quality article, using a single example to define an entire industry They put no effort into finding places where AI is making things better in healthcare. One example I know of, https://ferrumhealth.com/ https://ferrumhealth.com/
- adolph 3y agoTo all the sibling comments saying "insurance is part of the 'Healthcare System,'" well, the headline could have said "Health Insurance" but instead chose a broader category. The parent comment is helpful because it adds context. Further, the anecdatum of one provided in the article doesn't support the use of "AI" in the headline nor the thesis that "'AI Is Supercharging" anything. It refers to an algorithm that the company never divulges. It could just as well be a random number generator or a magic eight ball as much as it is "AI." The article is a clickbait moment of hate.
- rchaud 3y agoEarlier discussion on this topic, with the original source link from ArsTechnica: https://news.ycombinator.com/item?id=38299921 https://news.ycombinator.com/item?id=38299921 (Nov 17, 2023) As I said on that thread: the dangers of AI will always come down to human decisions made on how it should be applied. These 'solutions' will come from the McKinseys and IBMs of the world to serve hospital CEO needs, not those of patients or care providers. For those thinking that AI will reduce healthcare costs by improving efficiency, I point you to the 'electronic medical records' hype of 15 years ago. Are per capita healthcare costs any lower now?
- hotnfresh 3y agoYep. The actual risk of “AI” in the medium term is that these things are gonna mostly be used for optimizing the shit out of extracting money from normal people (i.e. pushing down the standard of living) while all normal folks will get out of it is fancy autocomplete. Great. Shifting the power and information imbalance farther toward large corporations is exactly what our flavor of capitalism needed. /s (Mostly, in the legitimate, if you will, economy, that is—they’re also gonna be hugely useful to scammers and astroturfers)
- geodel 3y ago> The actual risk of “AI” in the medium term is that these things are gonna mostly be used for optimizing ... I like this. I will further add since In the long term we are all going to die it will be fine for everyone :-)
- snowpid 3y ago" For those thinking that AI will reduce healthcare costs by improving efficiency, I point you to the 'electronic medical records' hype of 15 years ago. Are per capita healthcare costs any lower now? " Can you elaborate? In countries like Denmark or Estonia electronic medical records are well used among doctors and patients.
- LegibleCrimson 3y ago
- miah_ 3y agoIts supercharging the worst in everything its applied to. Try getting a job right now. All of the automated systems that are doing screening will throw you out if you aren't 100% compatible with whatever they're looking for. Sure, its cheaper than human screening, but now you've got a position not filled for even longer, which is probably costing you in other ways.
- apwell23 3y ago> screening will throw you out if you aren't 100% compatible with whatever they're looking for how does one know if this it the reason they are being thrown out.
- lordnacho 3y agoYou make up a CV that exactly matches the job advert and see whether there's a response
- sevagh 3y agoThis doesn't rule out that there were enough good or "better" applicants that crowded yours out.
- lordnacho 3y agoOf course it does, you send a few of these perfect CVs and see what happens.
- apwell23 3y agoWhy would a human also not choose a perfect CV over other options. What does this prove about AI.
- avgDev 3y agoHuman can look at a CV which doesn't match but say I like what this person has done, learning our stack should be no big deal.
- honkycat 3y agoI got a new job recently and I have been saying this is what I will be doing, writing AI to deny claims, AS A JOKE. We pay taxes so the government can pay to subsidize these healthcare corps that just serve to funnel money to its already rich shareholders. Healthcare is a pathetic broken mess and it will never get better.
- cornel_io 3y agohttps://www.marketwatch.com/investing/index/sp500.35?countrycode=xx https://www.marketwatch.com/investing/index/sp500.35?country... is up by less than the S&P over the last few years. I'm not saying the healthcare system is great or anything (I generally agree with "pathetic broken mess"), but it's not making its investors particularly rich. Most of the excess cost is getting spread out within the system itself and never makes it through the other end. If you want to blame doctors, nurses, admins and suppliers that's arguably a better place to start.
- staunton 3y ago> it will never get better Don't lose hope, other countries manage to be a lot better. It's possible if you only try.
- adnmcq999 3y agoYou would have to somehow scare our elected reps into doing what is right Or start our own “people’s hospitals” or even insurance (there should not be insurance schemes IMO) Or maybe not pay existing hospitals/ insurance companies I do not know how else to “try”
- tstrimple 3y agoWe were one congressional vote away from a public option for healthcare. Let's not pretend it isn't explicitly one party obstinately refusing to do anything on healthcare and dozens of other issues. The answer isn't to scare our elected reps into doing what is right. It's to stop voting for Republicans.
- 3y ago
- asdajksah2123 3y agoI'm not sure I understand why AI is supposed to make anything better, at least under the regulatory regime we have right now. 1. AI doesn't do anything new. It's just human thinking done better in the best case scenario. So the plus side is that we may come up with ideas that a human might have come up with 10-15 years later. However, a lack of ideas is not the problem we face at all. We have solutions to nearly every problem we face. We have enough wealth to implement nearly every solution we have. The real issue we face is that the wealth is concentrated in certain hands that do not want it to make it to others' hands, and those who are capable of implementing the solutions we have prioritize maximizing the wealth they capture with those solutions. AI, as long as it remains in private wealth focused hands, will only serve to turbo charge these issues. 2. Under the current regulatory regime the responsibility of what AI does wrong is not clear. Much like how Uber, and the other gig economy companies leveraged the opportunities created by the spread of the smartphone to create a regulatory innovator, whose only real purpose was to dismantle regulations and impose costs on 3rd parties and capture profits for themselves, AI will and is initially again being used as little more than a legal innovation, using the gray area in terms of legal responsibility as an advantage to do things a company would never have a human employee do or to allow companies to use other people's works without paying for it, and not getting sued for the theft. Expect AI to continue spreading into more legal gray areas as companies take advantage of the lack of clarity on legal responsibility to raid and pillage our economy and societies.
- thesuitonym 3y agoYou don't understand because you think we have a society built around making life better for everyone. It's not. Our society currently is optimized for one thing: Making sure the rich stay rich, and the poor stay poor. In that respect, AI is amazing. AI requires a small upfront cost, then can do the job of thousands of people for the pay of less than one. It works 24 hours, and will never ask for more money. And it works exactly to the specification you set, and will never, ever do anything to help your customers.
- BobaFloutist 3y ago>you think we have a society built around making life better for everyone. You know, I don't think they do think that? I think they think that's what society should be, though.
- protoman3000 3y ago> Even when users successfully appealed these AI-generated determinations and win, they’re greeted with follow up AI-dictated rejections just days later, starting the process all over again. Wait, what? Does that mean they can just take your money and reject your request to cover treatment until you die even if you had every right to do so?
- manicennui 3y agoYes, this is what Americans mean when they parrot bullshit about freedom: the freedom for corporations to do whatever they like in pursuit of profit.
- cryptonector 3y agoWe don't have a free market in healthcare in the U.S. though. You can be for a free market and against the abomination we currently have. If we just went back to 80%/20%, high-premium-or-high-deductible proper insurance, no HMOs, no PPOs, no co-pays, none of that nonsense, with published pricing, then we'd have a free market.
- sofixa 3y agoIs the regulations that are forcing co-pays, networks, obscured pricing? From the outside it sounds like the market doing it's best to extract as much money as possible, with the occasional regulation designed to look like someone is trying to fix the mess with a pretty bandaid (like the recent one on detailed upfront pricing).
- cryptonector 3y agoERISA started the ball by making it employers' responsibility to provide healthcare for employees, and then more "reforms". These things led to the current sorry state of healthcare in the U.S.
- manicennui 3y agoThanks for proving my point.
- zaptheimpaler 3y agoAlternate headline: "Our Healthcare System continues to deny claims, now with AI". Makes it clearer who the culprit is.. its not AI. They have been denying claims for decades without any help from AI too.
- tempodox 3y agoYes, but if “AI” denies you, humans are suddenly no longer responsible.
- zaptheimpaler 3y agoThe company using the tool is responsible regardless of how the decision is made, same as it is today, for whatever good that does us.
- FireBeyond 3y agoMost of these systems just present an RN (and I'm not sure why this hasn't been challenged as practicing medicine without a license, other than the payers' argument probably being "you can still get this intervention/ treatment/ drug, we're just not paying for it") with a claim, and a list of reasons the system deemed that it can be denied. The RN's job is ostensibly to see if there's any one of those bullet points that needs to be vetoed.
- manicennui 3y agoIt will almost certainly be used make customer service worse as well. In "Ways of Being" James Bridle provides other examples of how corporations are going to use "AI" to exacerbate the problems they already cause in pursuit of profit.
- poszlem 3y ago> “AI” (or more accurately language learning models nowhere close to sentience or genuine awareness) has plenty of innovative potential. Unfortunately, most of the folks actually in charge of the technology’s deployment largely see it as a way to cut corners, attack labor, and double down on all of their very worst impulses. Having read the first paragraph with its profound and non-bias insight, I can only expect that the remainder of the article will offer a well-rounded and impartial exploration of the issue.
- __loam 3y agoAre you saying that statement is untrue?
- gumballindie 3y agoIn the UK it's already bad as it is - seeing a GP or doctor in person is essentially impossible. AI use will only worsen the issue. You can already use "virtual gps" where if you tell them you broke a nail or farted they-ll tell you you either have covid or cancer. Buyers beware.
- w1ntermute 3y agoFrom the article linked by Techdirt: “executives have sought to almost entirely subordinate clinical case managers’ judgment to the computer’s calculations” Sounds like the issue is the executives. What does this have to do with “AI”? Also, the company that built this tech (naviHealth) was started in 2012. Their product existed long before large language models were created.
- mixdup 3y agoAI is the new crypto. If you can turn your head sideways and squint hard enough to make it seem like it might be in the same room as AI, it's going to get labeled as such I wager that 3/4 of the products out on the market purporting to be "AI" in the style of LLMs like GPT are just what was referred to as ML a year or two prior, or even worse just a standard computer program in the style of the past 20 years
- ysofunny 3y ago[flagged]
- xrd 3y agoNever in a million years could I have imagined there would be something worse than navigating the health care system. Hours of phone calls with deliberately confusing systems, impotent customer service representatives and no choices. It's like the movie Brazil already. Why wouldn't they add AI? Great idea.
- friendly_deer 3y agoHah. There's literally an AI startup designed to automatically navigate confusing phone trees to get information from health systems: https://outbound.ai https://outbound.ai
- kyleee 3y agoTruth is stranger than fiction
- HankB99 3y ago> How bad is the AI? A recent lawsuit filed in the US District Court for the District of Minnesota alleges that the AI in question was reversed by human review roughly 90 percent of the time: Isn't that about the same for non-AI interactions with US health insurance carriers? Their job is to make money and they do that by denying claims whenever they can. It's truly an awful experience.
- RajT88 3y ago> Though few patients appeal coverage denials generally, when UnitedHealth members appeal denials based on nH Predict estimates—through internal appeals processes or through the federal Administrative Law Judge proceedings—over 90 percent of the denials are reversed, the lawsuit claims. The PHB's in charge probably view this as a win. A 10% savings!
- bawana 3y agoDo any of you remember how healthcare was in the 60s before corporate America got involved? It just worked. The uninsured got taken care of. A 300 bed hospital had 3 administrators. Now we have a whole army of people in the hospital who have to justify their jobs by the number of emails they send.
- ngai_aku 3y agoThe ‘60s were 55+ years ago, so it’s unlikely that many here remember that.
- ok123456 3y agoDoctors should start using LLMs to deal with the appeals.
- secretsatan 3y agoIt’s probably working exactly as intended, they can hide behind the appeal process, but i would bet they’re thinking of the savings on those that don’t appeal
- black_13 3y ago[dead]
- a_gnostic 3y agoWhat worries me with AI is *garbage-in, garbage-out*. As seen with current year chatbot responses skewered by programmer's politics. If only Aaron would have succeeded liberating all medical knowledge already in the public domain; Then we could ensure AI's honesty.