6 ms·
When Sci-Hub made a lot of papers available to the public, I started clicking through to more references on Wikipedia. My goal was to learn more and go deeper
by Aurornis 3y ago
When Sci-Hub made a lot of papers available to the public, I started clicking through to more references on Wikipedia.
My goal was to learn more and go deeper on subjects, but I was stunned by how often the linked citation didn't support the claim in the Wikipedia article. There were many times where the linked citation said the opposite of the Wikipedia article.
My theory was that overly competitive Wikipedia authors were skimming PubMed abstracts and assuming the paper would support their assertion. Ironically, some of the statements with 5 or more citations were the most incorrect.
Trying to correct these articles is some times like going to war with editors who refuse to admit they were wrong.
- ravenstine 3y agoNot only do some papers not support the claim at all (I found this to often be the case when I used to read the news regularly), but there is often a critical detail left out of the abstract that is key to how the study should be interpreted. The vast majority of people citing papers, by my measure, are relying solely on the abstract even when the entire paper is available for free. This is often the case outside of Wikipedia as well. Truthfully, I'm a layman because I don't have an advanced degree that suggests I'm qualified to interpret papers, but things are bad enough IMO that part of me wishes people would stop trying to communicate science to the public until this broken system heals at least somewhat. On a related note, it doesn't help that folks like Andrew Huberman are normalizing this idea that one or two studies are good enough to form conclusions about how average people can "optimize" (micromanage) their lives in ways that are clinically relevant. This isn't to take away from the good that Huberman does, but I think it send a the wrong message to people who don't actually have any experience reading papers. One thing that might help is forbidding abstracts and conclusion sections in papers published in journals, which might cut down on some of the misunderstandings and make it harder to pass off a paper as support for a claim. > Trying to correct these articles is some times like going to war with editors who refuse to admit they were wrong. There is virtually no point in trying to fix Wikipedia pages until Wikipedia fixes themselves. They have an extremely hard job, but their prolific editors are too bully-like and contradict themselves all the time.
- wayfinder 3y agoYou need an abstract if you are looking up a topic and you’re scanning through articles though, and I think even if articles didn’t have abstracts, people would still link to papers to spin a narrative. I think this all really the cost of admission for the ease of self-publishing. Now any jerk off can post about their opinions on keeping abstracts while using the bathroom on company time.
- Karrot_Kream 3y agoEven when I was in grad school (sadly a while ago), it was understood that to really understand the validity of a paper, you needed to look at its conclusion and methods sections. Generally speaking the abstract was just used as a filter. It helped you answer the question of whether the paper was even worth taking a look at or not. Then you mined the conclusion and methods to see if they supported what you were looking for. Only then did you read the paper in detail. As you say there's a pretty big gap with the way researchers read through papers and the way the science media communicate about research with laypeople. It's a hard problem that needs more attention than it gets. (Probably one of the most useful classes I took in grad school was a class in the beginning that forced us to read 10 papers a week and write summaries. The class was hell as obviously there was no way to properly understand each paper on top of your research and other classes. But it made us great at being able to quickly winnow papers for the meat of each paper and also made us great at finding papers with... dubious methods.)
- sockaddr 3y agoYup. I often will read something like "A connection between X and Y" Then skim down to the conclusion and it will say "In conclusion, we were only able to see some weak connection and we aren't sure if it was one at all, but this warrants further research..." I know negative results are still valuable science, but I feel like a good chunk of the papers I'm reading are basically worthless CV padding.
- deleted 3y ago[deleted]
- nolist_policy 3y agoIt's also a result of Wikipedia's insistence to provide a citation or reference for every single thing/claim. Turns out its easy to find a reference for anything if you search long enough.
- fsflover 3y agoWhat do you suggest, not to provide a citation for every claim?
- entropicdrifter 3y agoI don't think they're arguing against the use of citations in general, but just pointing out that anyone with sufficient motivation acting in bad faith can find something official looking that seems to support their opinion. In other words, citations alone are insufficient
- fsckboy 3y ago> anyone with sufficient motivation acting in bad faith can find something official looking that seems to support their opinion you just summed up wikipedia on any political issue.
- zo1 3y agoHow about in-between: Not provide a citation until a claim is disputed, then go into a "let's weigh and vote on the citations that support A or B, and go with the one that has the most". My big problem and theory of what will be the downfall of Wikipedia: No Original Research.
- mardifoufs 3y agoThat would lead to levels of stone walling so extreme that no one would actually bother engaging. We already have that right now, with editors treating some articles like fiefdoms and being very combative to any change. Usually using pedantry or the revert rules. Imagine if you could just make any claim, and then there needs to be a process just to disprove it. Plus with the 3 revert rule it would basically turn the entire website into hell.
- gwern 3y ago> My goal was to learn more and go deeper on subjects, but I was stunned by how often the linked citation didn't support the claim in the Wikipedia article. There were many times where the linked citation said the opposite of the Wikipedia article. WP is, unfortunately, not obviously any worse than researchers in general are: https://gwern.net/leprechaun#miscitation https://gwern.net/leprechaun#miscitation > Trying to correct these articles is some times like going to war with editors who refuse to admit they were wrong. Yep. Because now you are doing 'OR' by interpreting the paper, especially when the abstract is just lying/spin.
- BestGuess 3y agoDon't even have to be about science, it can just be random little myths that spring up people try to correct. I happen to know stuff about firearms, got quite a few, from one of those places people can have quite a few. One day I'm scrollin down reading history on the M16 trying to remember something and I find the dumbest goddamn thing I ever heard, this claim the M16 got issued without cleaning kits and Colt claimed it was "entirely self-cleaning". I don't know if ya ever used firearms but that would never happen, and is the absolute dumbest claim I ever saw in my life. "reduced fouling" don't mean "entirely self-cleaning". Now I don't really know how to use wikipedia but I thought it was one of those fake edits people might do as a joke. Went checking edit history and stuff to find out and turns out someone else tried to point out the myth too and some jackass with authority is jealously guarding that myth to keep it on the page forever. Went and checked the government documents myself, among other things there is no Colt material making that claim in that context. Government also ordered cleaning kits, Colt supplied cleaning kits, so it's also contradicted by fact there too. Simple thing is there just weren't enough to go around, supply shortages, and someone at some point created the myth by misunderstanding that a design to "reduce fouling" thereby "reduce cleaning" don't in any way no hell no how imply "self-cleaning" in that way. Yet the claim remains on wikipedia, without clarification, because I guess some idiots repeating the myth in a book makes the myth okay. I went and checked that book, too. No source of the myth in the cited book. It's completely fuckin made up and anyone with half a brain and a day using a firearm would know that, but there it is. All because someone, for some reason only God knows, personally wants it to be there and has the authority to keep it there.
- slaymaker1907 3y agoHonestly, I think the introduction and conclusion are almost always more important than the abstract. If you read the abstract, introduction, and conclusion, you should be able to understand the scope of what was done and what the paper actually shows.
- murphyslab 3y agoThere's an incentive for scholarly publishers and authors to have their works cited on Wikipedia, since there is a belief (supported by some research [0]) that citation on Wikipedia increases subsequent scholarly citations to those articles. Such a benefit could be used to increase a Journal Impact Factor & similar metrics [1,2] or the citations to one's own works, which is beneficial to academics competing for promotion, tenure, and research grants which are partially based on citation metrics.[3] I wouldn't be surprised if there was some indiscriminate citation on Wikipedia to bolster the metrics. [0] https://scholarlykitchen.sspnet.org/2022/11/01/guest-post-wikipedias-citations-are-influencing-scholars-and-publishers/ https://scholarlykitchen.sspnet.org/2022/11/01/guest-post-wi... [1] https://en.wikipedia.org/wiki/Impact_factor https://en.wikipedia.org/wiki/Impact_factor [2] https://en.wikipedia.org/wiki/Citation_impact https://en.wikipedia.org/wiki/Citation_impact [3] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6668985/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6668985/
- poszlem 3y agoOver time, I've come to see that Wikipedia mirrors the broader internet: initially heralded as a game-changer, but when it really counts, it can be just as unreliable as the things that preceded it, if not worse. I keep thinking of that quote from the Office: "Wikipedia is the best thing ever. Anyone in the world can write anything they want about any subject, so you know you are getting the best possible information."
- sheepshear 3y agoI had a math professor who would occasionally correct an equation in the Wikipedia article about some theorem he invented, but someone would always change it back. He eventually gave up.
- SoftTalker 3y agoWikipedia doesn't accept primary sources. You could be the inventor of a thing, but you'd be unqualified to write a wikipedia entry about it. You'd have to get someone else to write about it, get that published, and then cite that in wikipedia.
- fsckboy 3y ago>Wikipedia doesn't accept primary sources wikipedia accepts published papers from journals as references, despite that those are primary sources. (I thought they originally didn't, but they do now) How would this guy's theorems be on wikipedia if he hadn't published them? Wikipedia is leery of people editing "their own page" in the sense of conflict of interest, but cleary if you are correcting a published theorem, that is entirely within bounds. You could say on the Talk page "I published this theorem, wikipedia has it wrong."
- sheepshear 3y agoThere was plenty written about it. Whoever wrote the article was confidently incorrect about how they interpreted what was written.
- mhh__ 3y agoThere is a talk page where you're supposed to hash this kind of thing out. What was the equation?
- sheepshear 3y agoHe used the talk page. I have it in my notes in a box in storage. I'll dig it up probably in the next 10-20 years, if you can wait.
- Krasnol 3y agoDid you fix it?
- fturst 3y ago> Trying to correct these articles is some times like going to war with editors who refuse to admit they were wrong.
- thaumasiotes 3y agoWikipedia's policy is that errors in existing pages should not be fixed.
- seb1204 3y agoWait what? Is the whole point of wiki not to improve and correct?
- thaumasiotes 3y agoTry it and see what happens.
- mch82 3y agoThe actual policy is to improve accuracy: https://en.m.wikipedia.org/wiki/Wikipedia:Accuracy_dispute https://en.m.wikipedia.org/wiki/Wikipedia:Accuracy_dispute
- thaumasiotes 3y agoAre Wikipedia's "actual" policies the things that Wikipedia says it does, or the things that Wikipedia actually does?
- Krasnol 3y agoI don't know where you are going, but I did fix several articles already and never had a single issue with it because my sources were correct. Yes, there might be bad actors, but it doesn't mean that everything is bad and impossible. You should try first, at least.
- btrettel 3y agoUnfortunately, many people treat citations as a formality rather than something to help someone judge credibility. I try to cite as specifically as possible. Cite the page if possible (and which column if available), section if possible, and if you want to go the extra mile, the paragraph or line number if possible. That makes checking easy. This was common when I worked at the USPTO as a patent examiner, but wasn't standard practice when I was in academia. Previous comment of mine on this issue (including a bit about how to make URLs more specific): https://news.ycombinator.com/item?id=23897686 https://news.ycombinator.com/item?id=23897686
- PhasmaFelis 3y agoI am still irrationally annoyed that somebody made a Wikipedia article for their own made-up definition of high vs. low fantasy ("another world" vs. "our world", as opposed to the common definition, which was basically Tolkien vs. GRR Martin), based on a single decades-old article that didn't even mention the phrase "low fantasy", and managed to unilaterally change the definition. No one could find a reference to contest it with, because nobody was writing articles defining terms that everyone understood; and the original editor's reference was not available online at the time, so no one could look at it and say "Uh, this is just some rando saying it would be cool if we called secondary-world stories 'high fantasy'." Now the original, bogus reference is gone from the article, replaced with 20 low-effort articles that are obviously sourced from the same Wikipedia page they're being used to support. Boom, citogenesis! https://xkcd.com/978/ https://xkcd.com/978/
- emj 3y agoFeedback: love fantasy do not see the problem. The only thing you need to remember is that communication usually fails except by accident. I have seen many definition change meaning during my life it is just part of life. If you are content that you have the same definition you usually do not. https://en.wikipedia.org/wiki/Wiio%27s_laws https://en.wikipedia.org/wiki/Wiio%27s_laws
- RecycledEle 3y ago> Ironically, some of the statements with 5 or more citations were the most incorrect. There is nothing thing ironic about it. Wikipedia is run by bullies who make up references.