3 ms·

This kind of information is useless without a baseline The problem is not so much the quantity of errors (that’s a problem too) but the severity of them. These

This kind of information is useless without a baseline The problem is not so much the quantity of errors (that’s a problem too) but the severity of them. These LLM “AIs” will produce convincing fabrications mixed in with bits of truth. When a human writes this sort of stuff, we call it fraud. Just earlier this week in my philosophy class we had ChatGPT produce a bio of our professor. Some details were right but others were complete fabrications. The machine gave citations of non-existent articles and books she’d apparently written. It said she’d previously taught at universities she’d never even visited. I don’t know how else to describe it other than amusing at best, dangerous fraud at worst.

xdennis 4y ago
> It said she’d previously taught at universities she’d never even visited. Don't worry. Some of the details will make it to some websites, which will be cited by the press, which will be included into Wikipedia, and it will become the truth. She will have taught at those universities if she likes it or not.
vharuck 4y ago
I recently used ChatGPT (the free 3.5 Turbo version) to list five articles about public health surveillance, asking for ones published since 2017. The list just had the article titles, authors, publications, and years. I had trouble finding the first one, so I asked the model for DOI numbers. It happily restated the article titles with DOI numbers. None of the articles were real. The authors were real (and actively published work after 2017). The publications were real, and often featured the listed authors. But the articles were all fake. Only one of the DOI numbers was legit, but it pointed to a different article (partial credit for matching the listed publication). So it can easily hallucinate not just nitty gritty details, but basic information. Thinking about it, the GPT models are trained on output, so they've picked up grammar, syntax, and conceptual relations between tokens (e.g., "eagle" is closer to "worm" than it is to "elegance"). But there are few, if any, examples of "first draft vs final draft." That could've been useful to pick up on how discretion and corrections are used in writing.
0xedd 4y ago
Clueless, to say the least. Humans tasked with the same, having no extra information (aka context) will, on average, perform worse. If an AI performs better than the average human, why should I hire you? Both err, one is orders of magnitude cheaper (and GPT4 performs overwhelmingly better). Don't call us; We'll call you.

xdennis 4y ago

> It said she’d previously taught at universities she’d never even visited. Don't worry. Some of the details will make it to some websites, which will be cited by the press, which will be included into Wikipedia, and it will become the truth. She will have taught at those universities if she likes it or not.

vharuck 4y ago

I recently used ChatGPT (the free 3.5 Turbo version) to list five articles about public health surveillance, asking for ones published since 2017. The list just had the article titles, authors, publications, and years. I had trouble finding the first one, so I asked the model for DOI numbers. It happily restated the article titles with DOI numbers. None of the articles were real. The authors were real (and actively published work after 2017). The publications were real, and often featured the listed authors. But the articles were all fake. Only one of the DOI numbers was legit, but it pointed to a different article (partial credit for matching the listed publication). So it can easily hallucinate not just nitty gritty details, but basic information. Thinking about it, the GPT models are trained on output, so they've picked up grammar, syntax, and conceptual relations between tokens (e.g., "eagle" is closer to "worm" than it is to "elegance"). But there are few, if any, examples of "first draft vs final draft." That could've been useful to pick up on how discretion and corrections are used in writing.

0xedd 4y ago

Clueless, to say the least. Humans tasked with the same, having no extra information (aka context) will, on average, perform worse. If an AI performs better than the average human, why should I hire you? Both err, one is orders of magnitude cheaper (and GPT4 performs overwhelmingly better). Don't call us; We'll call you.