7 ms·
Papers coming out of China and Taiwan need to be regarded skeptically; this reminds me a lot of the fairly recent "China's academic scandal: call toll-free hotl
by gwern 12y ago
Papers coming out of China and Taiwan need to be regarded skeptically; this reminds me a lot of the fairly recent "China's academic scandal: call toll-free hotlines to get your name published" http://www.wired.co.uk/news/archive/2013-12/02/china-academic-scandal http://www.wired.co.uk/news/archive/2013-12/02/china-academi...
- hga 12y agoThe particular problem that article is talking about is one in the PRC, not extending to Taiwan. As I understand it, orders came from on high (by definition the Communist Party of China) driving this. Which is not to say the "publish or perish" problem isn't endemic, and that we can safely assume Taiwan is about as bad as any other "normal", non-cargo cult science country.
- gwern 12y agoBecause Taiwan is so close to the PRC, in every sense of the word, you have to worry. Has the Taiwanese government been enacting China-like policies? When researchers return to Taiwan, do they bring with them corrupt practices? Or even just beliefs in evaluating researchers by publication count? Do the revelations about Chinese papers encourage Taiwanese researchers to try their own hand at it, and normalize it? Are there any underlying cultural factors which might be the same in both countries? And so on. > that we can safely assume Taiwan is about as bad as any other "normal", non-cargo cult science country. I wouldn't say that. For example, there's a strikingly consistent observation that close to 100% of acupuncture experiments succeed when they are done in East Asia (which is pretty much impossible for any effect size) despite rates halving when you move out of the region; is the placebo effect that much stronger in East Asia, or does this reflect investigator bias / incentives to get positive results by any means etc?
- nknighthb 12y agoMy experiences with the business climates of Taiwan and China suggest to me that the set of "senses" you and I have associated with the word "close" must be vastly different.
- seanmcdirmid 12y agoThe universities are set up similarly, many of China's flagship universities exist in both PRC and ROC (e.g. Qinghua). In other aspects, Taiwan is closer to Japanese culture (or so I hear, I've never stepped foot in ROC before).
- taejo 12y agoWhile there is a Qinghua/Tsing Hua university in both, they're competing rather than coöperating organisations, as far as I can tell.
- seanmcdirmid 12y agoYep, but same roots.
- beachstartup 12y agowhy use critical thinking and actually go to these places, when a little bit of casual racism will do quite nicely instead?
- hackuser 12y ago> Papers coming out of China and Taiwan need to be regarded skeptically Do we know that China and Taiwan are worse? There are scandals in the U.S. too, such as papers funded by business interests without disclosure.
- deleted 12y ago[deleted]
- mikeyouse 12y agoIn many scientific fields, initial results out of China are almost entirely ignored. It might not be fair to the honest researchers, but the amount of fraud from China is staggering. This goes far beyond unclaimed conflicts of interest. Many publications have looked into the problem: [1] http://www.economist.com/news/china/21586845-flawed-system-judging-research-leading-academic-fraud-looks-good-paper http://www.economist.com/news/china/21586845-flawed-system-j... In 2010, however, Nature had also noted rising concerns about fraud in Chinese research, reporting that in one Chinese government survey, a third of more than 6,000 scientific researchers at six leading institutions admitted to plagiarism, falsification or fabrication. [2] http://www.nytimes.com/2010/10/07/world/asia/07fraud.html?pagewanted=all&_r=1& http://www.nytimes.com/2010/10/07/world/asia/07fraud.html?pa... Last month a collection of scientific journals published by Zhejiang University in Hangzhou reignited the firestorm by publicizing results from a 20-month experiment with software that detects plagiarism. The software, called CrossCheck, rejected nearly a third of all submissions on suspicion that the content was pirated from previously published research. In some cases, more than 80 percent of a paper’s content was deemed unoriginal. [3] http://www.wired.co.uk/news/archive/2013-12/02/china-academic-scandal http://www.wired.co.uk/news/archive/2013-12/02/china-academi... "Many agencies have toll-free hotlines and customer service representatives working ten hours a day. Some even list the titles of papers for sale, or the names of journals with which they supposedly collaborate, on their websites. It's a sort of Wild West of academic publishing. You have a whole laundry list of services on offer that many scientists would probably never imagine to be possible."
- sillysaurus3 12y ago
- seanmcdirmid 12y agoThanks a lot! Not all if us publishing out of the PRC are corrupt, and any bias by PC members based on country of origin would be unethical and probably racist!
- jerf 12y agoYour response is the natural instinct, but it's ultimately misplaced. It is completely rational for people to notice that corruption is highly correlated to certain locations in the world, and you're not going to be able to just assert your way into making that false. The correct response is to make it irrational by making it not true, and working to root out the corruption in question. It's hard. I don't even have words to describe how hard that is. But it does at least stand a chance of working. (This seems to be ground deeply into the human psyche. In general, a group of any kind is best off in the long term if the group polices itself for misconduct more aggressively than any outsider could. But the human instinct is to band together, assist each other to various degrees in covering over problems (often not even deliberately per se, but as a side effect of the system's structure), and band together to attack anyone external who notices anything amiss. This, alas, works in the short term quite well, but is death in the longterm.)
- coldtea 12y ago>Your response is the natural instinct, but it's ultimately misplaced. It is completely rational for people to notice that corruption is highly correlated to certain locations in the world, and you're not going to be able to just assert your way into making that false. The correct response is to make it irrational by making it not true, and working to root out the corruption in question. That's like saying "blacks are lazy" and when someone complains you tell them that it's normal for people to make such correlations and that to fix this he has to work on "making it not true". You got it backwards. The burden of proof is on you. You have to prove what you state with regards to corruption is true. Not just speak like it's a given, and demand of them to fix it. >This seems to be ground deeply into the human psyche. (...) the human instinct is to band together, assist each other to various degrees in covering over problems (often not even deliberately per se, but as a side effect of the system's structure), and band together to attack anyone external who notices anything amiss. This is a generalization that can be said for all groups. Not a proof (or even an indication) that any charge of "something amiss" from somebody external is right. I have friends that studied in the UK (including Cambridge) and the US. My anecdotal evidence is that tons of papers in Comp-Sci in those countries are also BS, to keep the churn rate up). And academics return favors to other academics all the time, with regards to favorable reviews, etc. (Btw, I'm not Chinese, so the pop psychology 101 above doesn't apply).
- cyorir 12y agoWhile I can see the point that research from China is harder to verify in some cases, I think the statement "Papers coming out of China and Taiwan need to be regarded skeptically" goes a bit far. China has strengths in some fields, and even if research institutes in China are of lower average quality than their western counterparts, there remain some that are still of high quality. Are you forgetting that Hong Kong is part of China, and has research links to top universities in the Chinese mainland? Well Hong Kong provides the example of HKUST, a high-quality university which I would claim provides a leading example for research coming out of Asia.
- Chronic29 12y agoLeading research out of Asia does not excuse it from skepticism. HKUST, whether #1 or not, must be scrutinized the same as China Rural University.