3 ms·

LLMs hallucinate way too much for use in anything serious. And the privacy implications are harrowing I barely even trust LLMs anymore to help me with orientat

LLMs hallucinate way too much for use in anything serious. And the privacy implications are harrowing I barely even trust LLMs anymore to help me with orientating research, I keep finding out that half of what it says is a lie

postalrat 3y ago
Are you saying it's better they don't try? But you tried... Not quite sure what to think.
stephen_cagle 3y ago
I totally agree on the hallucination front, that is a big problem. But the privacy thing is less of a concern if we are only talking about "using" (not training) these medical models. You could upload your entire medical history to such a model within the context window, and then provide your latest symptoms to get a diagnostic from the LLM. The LLM has not remembered any information about you at this time (it isn't "within" the model itself), it is only in the context window. Anyway, just pointing out that there is a world of difference between training these models and using these models. If you are only using, there is really very little fear of privacy assuming the whole interaction is discarded.
AussieWog93 3y ago
Have you tried GPT-4? Haven't seen it hallucinate once out of the 100+ questions I've asked it. The one mistake I've seen it make was giving me the wrong pin number when asking it to read a datasheet via a plugin, but even then it was a real pin and I wasn't using core GPT-4.
SkyPuncher 3y ago
Sure, but have you seen the workload of most doctors? A huge portion of it is simply writing notes on patients. Note writing is ripe for an LLm, even with hallucinations. Write out your quick bullet points, let the LLM expand that content, re-read and correct. Since a human remains in the loop, it doesn’t have to be perfect.
bobosha 3y ago
Hallucinations will be squelched out pretty soon. Check perplexity ai app, it works pretty well with little/no hallucination imo.
mensetmanusman 3y ago
Reading with the mindset of 'spot the hallucination' actually helps me focus more on the output of gpt4 and learn more quickly from it. I don't read Wikipedia with as critical an eye.

postalrat 3y ago

Are you saying it's better they don't try? But you tried... Not quite sure what to think.

stephen_cagle 3y ago

I totally agree on the hallucination front, that is a big problem. But the privacy thing is less of a concern if we are only talking about "using" (not training) these medical models. You could upload your entire medical history to such a model within the context window, and then provide your latest symptoms to get a diagnostic from the LLM. The LLM has not remembered any information about you at this time (it isn't "within" the model itself), it is only in the context window. Anyway, just pointing out that there is a world of difference between training these models and using these models. If you are only using, there is really very little fear of privacy assuming the whole interaction is discarded.

AussieWog93 3y ago

Have you tried GPT-4? Haven't seen it hallucinate once out of the 100+ questions I've asked it. The one mistake I've seen it make was giving me the wrong pin number when asking it to read a datasheet via a plugin, but even then it was a real pin and I wasn't using core GPT-4.

SkyPuncher 3y ago

Sure, but have you seen the workload of most doctors? A huge portion of it is simply writing notes on patients. Note writing is ripe for an LLm, even with hallucinations. Write out your quick bullet points, let the LLM expand that content, re-read and correct. Since a human remains in the loop, it doesn’t have to be perfect.

bobosha 3y ago

Hallucinations will be squelched out pretty soon. Check perplexity ai app, it works pretty well with little/no hallucination imo.

mensetmanusman 3y ago

Reading with the mindset of 'spot the hallucination' actually helps me focus more on the output of gpt4 and learn more quickly from it. I don't read Wikipedia with as critical an eye.