3 ms·
Could you run a similar analysis for pre-2020 papers? It'd be interesting to know how prevalent making up sources was before LLMs.
by smallpipe 9mo ago
Could you run a similar analysis for pre-2020 papers? It'd be interesting to know how prevalent making up sources was before LLMs.
- tasuki 9mo agoAlso, it'd be interesting how many pre-2020 papers their "AI detector" marks as AI-generated. I distrust LLMs somewhat, but I distrust AI detectors even more.
- theptip 9mo agoYeah, it’s kind of meaningless to attribute this to AI without measuring the base rate. It’s for sure plausible that it’s increasing, but I’m certain this kind of thing happened with humans too.
- jcmp 8mo agoat the end of the article they made a clear distinction between flawed and hallucinated cititations. I feels its hard to argue that through a mistake a hallucinated citation emerge: > Real Citation Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. Deep learning. nature, 521:436-444, 2015. Flawed Citation Y. LeCun, Y. Bengio, and Geoff Hinton. Deep leaning. nature, 521(7553):436-444, 2015. Hallucinated Citation Samuel LeCun Jackson. Deep learning. Science & Nature: 23-45, 2021.