3 ms·

According to this study, they are as reliable as doctors (for ED's context)[1]. Also, Google has developed Med-PaLM 2, which they also say matches human doctors

According to this study, they are as reliable as doctors (for ED's context)[1]. Also, Google has developed Med-PaLM 2, which they also say matches human doctors. So yeah, they may be unreliable. But they are as unreliable as humans. [1]https://www.sciencedirect.com/science/article/pii/S019606442300642X?dgcid=author#fig1 https://www.sciencedirect.com/science/article/pii/S019606442...

corethree 3y ago
I wouldn't bet on that study. ChatGPT hallucinates. It can beat doctors but at the same time deliberately present wrong information. Doctors at least make a best effort.
- rafaelero 3y ago
  I don't care about best effort. I care about getting the correct diagnosis. GPT-4 can already offer insightful information, even if it's just by augmenting the doctors diagnosis efforts. Not using it is just dumb.
  - corethree 3y ago
    I hate doctors but at the same time you have to look at reality. Not every decision needs to be data driven, the qualitative aspects of hallucinations are very real and should not be ignored. I'm sure you know the hallucinations that pop out of chatGPT can get wild. Definitely use it, but do so with caution.
- fragmede 3y ago
  > Doctors at least make a best effort. lol. Just skim the CFS thread for counterexamples
  - corethree 3y ago
    Eh best effort in terms of not killing you and harming you too much... that's what I meant. For chatGPT hallucinations, anything goes, you know that machine has no boundaries so that has to be taken into account.
rvz 3y ago
> But they are as unreliable as humans. Humans can be held to account by other humans if investigations are necessary to explain their own decisions transparently. LLMs such as Med-PaLM, ChatGPT, and fundamentally all LLMs are non-deterministic and are unpredictable in whatever they give as their output, which is much more unreliable and cannot reason or explain themselves transparently why they decide to output their responses, but shuffle and reword their sentences randomly to make themselves appear coherent to the untrained eye, but when scrutinised by a professional, it is mostly garbage. You would not seriously trust an AI to pilot a plane end to end without any human pilots on board or a FSD system to drive you from A to B whilst you sit at the back seat.
- rafaelero 3y ago
  > You would not seriously trust an AI to pilot a plane end to end without any human pilots on board or a FSD system to drive you from A to B whilst you sit at the back seat. Well, people are doing exactly that with Waymo and Cruise, but with cars.
- fragmede 3y ago
  > You would not seriously trust... a FSD system to drive you from A to B whilst you sit at the back seat. You might not, but I took a Cruise just the other day to a friend's house. Didn't even die or get into any accidents! (San Francisco)

corethree 3y ago

I wouldn't bet on that study. ChatGPT hallucinates. It can beat doctors but at the same time deliberately present wrong information. Doctors at least make a best effort.

rafaelero 3y ago
I don't care about best effort. I care about getting the correct diagnosis. GPT-4 can already offer insightful information, even if it's just by augmenting the doctors diagnosis efforts. Not using it is just dumb.
- corethree 3y ago
  I hate doctors but at the same time you have to look at reality. Not every decision needs to be data driven, the qualitative aspects of hallucinations are very real and should not be ignored. I'm sure you know the hallucinations that pop out of chatGPT can get wild. Definitely use it, but do so with caution.
fragmede 3y ago
> Doctors at least make a best effort. lol. Just skim the CFS thread for counterexamples
- corethree 3y ago
  Eh best effort in terms of not killing you and harming you too much... that's what I meant. For chatGPT hallucinations, anything goes, you know that machine has no boundaries so that has to be taken into account.

rvz 3y ago

> But they are as unreliable as humans. Humans can be held to account by other humans if investigations are necessary to explain their own decisions transparently. LLMs such as Med-PaLM, ChatGPT, and fundamentally all LLMs are non-deterministic and are unpredictable in whatever they give as their output, which is much more unreliable and cannot reason or explain themselves transparently why they decide to output their responses, but shuffle and reword their sentences randomly to make themselves appear coherent to the untrained eye, but when scrutinised by a professional, it is mostly garbage. You would not seriously trust an AI to pilot a plane end to end without any human pilots on board or a FSD system to drive you from A to B whilst you sit at the back seat.

rafaelero 3y ago
> You would not seriously trust an AI to pilot a plane end to end without any human pilots on board or a FSD system to drive you from A to B whilst you sit at the back seat. Well, people are doing exactly that with Waymo and Cruise, but with cars.
fragmede 3y ago
> You would not seriously trust... a FSD system to drive you from A to B whilst you sit at the back seat. You might not, but I took a Cruise just the other day to a friend's house. Didn't even die or get into any accidents! (San Francisco)