I experienced this recently in the scariest of circumstances -- a hospital. I have hemophilia, a bleeding disorder. Normally, its a nuisance that just requires

I experienced this recently in the scariest of circumstances -- a hospital. I have hemophilia, a bleeding disorder. Normally, its a nuisance that just requires I take medication on semi-daily basis. If I don't take the medication, I'll usually be fine, except if I have an active bleed, which will just continue to bleed, causing damage to my body, and can be life threatening depending on the location of the bleed. I was recently traveling back home and I ran out of my medication. It's a specialty medication that you can't find in pharmacies. It normally has to be shipped to me. I had ordered some but it wouldn't arrive for another day. I was having an active bleed in my torso, of all places, which is an odd place and distressing because its close to so many important body systems (the spine, major arteries). The thing about my condition is that normally bleeds are innocuous, but you never know. I always be on the safe side, because when I haven't its often meant months-long recovery. Anyway, I figured no problem, I'll just go to the hospital ER and get some medication, which is what I'm supposed to do and I've done before -- but not in a long time. Most all major metro hospitals carry my medication. I went to the hospital and told them about my condition and what I needed. They wanted me to take a CT scan, which I declined (I already knew what I was dealing with and just needed my medication). Then, they wanted to test me for hemophilia (I've had the condition since birth), a very expensive and lengthy test that takes hours. After finally speaking with a doctor, he declined to give me my medication until I both consented to the CT scan and the test for hemophilia (despite me having official medical identification that explains my condition). I didn't want the CT scan because its ungodly expensive and exposes your body to a lot of radiation (100x an x-ray). You could clearly tell it was a bleed due to swelling, bruising, heat, and my prior medical history. And I've lived with the condition for awhile so I am very attuned to these problems. I experienced what I can only describe as a similar type of hostility as someone coming in seeking drugs to get high (my medication neither makes you high nor is dangerous, except when I don't get it). Curious as to why I was being treated this way, I pressed further. The doctor came back with a print-out from some medical "AI" software. It had not only determined what the proper course of action was to be (the tests before my medication), I was also informed that if the staff deviated from the "process" at all, they would risk being fired. There you have it. All decision-making ability had been revoked from even the doctors. They were prepared to let me bleed for hours, while waiting on a test to confirm a condition I've had since birth rather than risk deviating from some computer-generated "AI" policy. Even more sinister, since it was a screenshot (done with print screen) of the windows-based software, I spotted something else: something called a "risk score". It was a gauge-like visualization that had rated me in the "riskier" category. No doubt this was also the case with patients who are drug seeking, and I hypothesize this was the reason for the apathy and apprehension I detected. It kind of reminds me of the Critical Care episode of Star Trek: Voyager, where patients have been reduced to a "TC" -- treatment coefficient that determines who gets good care and who doesn't and is based on the person's accomplishments and value to society. Honestly, we're not far off from that. What would happen if I came into the ER with a serious problem that required immediate treatment? Would they defer to this software and watch me die while waiting on tests? I know my condition is rare, I'm used to educating doctors about it, but the fact that the doctors seemed unwilling to even compromise and do the right thing was alarming to me, and also sad. Its like they have become customer service representatives of a large corporation and they know it, and so they have divorced themselves of any care or humanity at all. I decided to leave and take my chances on waiting the day, rather than sit there for hours. At that point, I was in extreme pain and I honestly didn't know if the bleed would resolve itself or not. Worse case, I could always come back to the hospital. I guess. The bleed ended up resolving itself, and I eventually got my medication and was able to treat myself. Ironically, a nurse called later the next day to "check up on me". My tests had finally come back over a day later and confirmed my condition, and also that my factor level was low. After I told her the story I've just shared with you, all she could offer was to "make a note in your chart". That no-one will be looking at, and likely not influence the medical software at all. I looked on the hospital web site for contact information to try and lodge a complaint -- there was none. I also tried calling the hospital's 800 number, which was entirely automated and offered no ability to talk to anyone. In case anyone is wondering, the name of the hospital is Riverside in Columbus, Ohio (part of Ohio Health). It's a huge hospital. Anyway, this is my story about AI. Something to think about because as engineers we are the ones making these kinds of software and have an ethical and moral responsibility. We need to be aware of how people are going to use technology and actively work to prevent abuses, and hopefully build this into the software itself. What kind of science fiction novel are we living in?