15 ms·
Too many new papers may mean novel ideas rarely rack up citations
- pizzazzaro 5y agoIts almost like we dont invest in it anymore...
- deleted 5y ago[deleted]
- pas 5y ago> the newbies compete so intensely amongst themselves that they can’t compete with the established dominant choice — in the case of research, that often means [mostly only old papers get cited]. The article does not mention tenure and the publish or perish incentive (which forces academia to work like the auto industry, just-in-time manufacturing of incrementally better output). https://www.lesswrong.com/posts/gMszBSAX23uqYhytR/technological-stagnation-why-i-came-around?commentId=E2jXY52NF7xMX2mQ6 https://www.lesswrong.com/posts/gMszBSAX23uqYhytR/technologi... ( https://pbs.twimg.com/media/D6xm5DFX4AEjP3_.jpg https://pbs.twimg.com/media/D6xm5DFX4AEjP3_.jpg )
- blamestross 5y agoEquilibriums are often punctuated.
- DrNuke 5y agoScientific progress is still way ahead engineering readiness in terms of results… and engineering readiness, while catching up, validates and enables further scientific progress.
- ashtonkem 5y agoI wish the article had addressed the other issue in the area: funding. The US stopped lavishly funding scientific research sometime in the 1970s. Private industry has taken up the difference, but private industry wants to focus on immediately usable research for profit, rather than fundamental stuff that’ll be useful for the next century for all of society. Is it that surprising that the most cited research papers come from the tail end of the federally funded research era?
- dredmorbius 5y agoThat "lavish funding" era extended largely from WWII, with specific focus on technologies such as radar, fire-control (computers), and the Manhattan Project, was inspired strongly by Vannevar Bush's "Science: The Endless Fronteir" (itself something of an HN perennial), and kicked mightily in the keister by the Sputnik scare and nuclear / missile arms race of the 1960s. By a decade later, numerous factors had taken much of the steam out of the sails (to mix metaphors): the Vietnam war, foreign exchange and major changes in global currency, and the emergence of domestic peak oil in the US (lower 48 at least) with ceding of control over global petroleum production and prices to the Middle East, along with numerous consequences there. At the same time, Detante and the opening of China, and political scandals (most notably Watergate), and the civil rights and anti-war movements, changed attitudes toward government (amongst the Left) and toward academia (amongst the Right). The former is well documented through the general counterculture movement, the latter probably through the Lewis Powell Memorandum. At the same time, there was what I'd see as a real decline in the pace of both scientific and technological progress in almost all areas, save information technology and some materials science. TFA actually focuses fairly narrowly on one element, which is the explosion in publishing. I'll address that in a top-level comment, as I feel it's been overlooked by most other comments.
- philipkglass 5y agoI'd add a growing awareness of and concern for the environment. The United States had its "Moore's Law" era for nuclear technology for about 20 years after WW II. After that, concern about weapons test fallout and other environmental releases of radionuclides made experiments much slower and more expensive. To the extent that many ideas never left the drawing board. There are similar stories with chemical technology, manufacturing, even electricity generation. Fossil fuel depletion is one example of overtaxed sources. Strontium 90 in human teeth, acid rain, phosphate driven algal blooms, etc. are emblematic of overtaxed sinks. The US circa 1960 enjoyed a faster-than-sustainable pace of development (scientific and technological) by borrowing from the future on multiple axes.
- dredmorbius 5y ago
- goalieca 5y agoWas academia terribly relevant in my field when I was a grad student? Nope. In general, the work was poorly supervised, not-reproducible, and the peer review process was completely broken. Students just wanted to graduate and professors just wanted tenure and funding points.
- echelon 5y agoSomething has changed. I can't imagine Einstein's generation functioning like that. Have pioneers of innovation moved to private corporations now that they have capital that rivals academia? Private companies can reward innovators with more than just credentials. Bell Labs, Xerox Parc, Google Brain, OpenAI, Tesla, SpaceX, ... Granted, this isn't even across all fields as they are not all economic drivers.
- bjornsing 5y agoSomething I often think about is how eccentric the leading researchers were in Einstein’s generation. Just look at a picture of the guy himself. Or consider Kurt Gödel, who starved to death when his wife was hospitalized because he could only eat food prepared by her. Different times/cultures tend to put different personalities in charge, and that has a huge impact on what gets done. Overall I have a feeling the curious eccentrics are now out, and the charismatic corner cutters are in…
- deleted 5y ago[deleted]
- ldng 5y agoAnd even then, can you really put the two first in the same bag as the others ? I have the feeling their research scope were noticeably broader, no ?
- gameswithgo 5y agoBell Labs was only pseudo private. The government required they have that research lab in exchange for being allowed to have a monopoly. One should also consider that institutions like that were partly so productive for being at the right place and time in history, when we were developing the tools to exploit the low hanging fruit nature has to offer us. That whole era, we snatched it all up quick. Spaceflight and such didn't stagnate after because we turned to idiots, but because mass and aerodynamic drag and Newton impose pretty inalienable constraints.
- privong 5y agoI just wanted to note that the paper the blog post is discussing received some attention here on HN a little over 2 weeks ago: https://news.ycombinator.com/item?id=28821498 https://news.ycombinator.com/item?id=28821498
- xor99 5y agoI think this comes down to the growth of scientific management and technocracy in research and that bureaucracy's attempt to fight over dwindling public funding for the sciences coupled with lack of private non-commercial sources of funding. Universities are mostly made up of managers or researchers that end up acting like managers in order to justify their position. This leads to a set of bureaucratic rules for scientific success and a range of conferences that prop that system up. Disagreement, the possibility to be stupid and wrong, and the ability to take random choices based on intuition are eliminated when the majority of a field acts like scientific managers. I highly recommend reading "The Body Electric" which details an excellent example, in both technical and social terms, of how structural effects like the above impede highly "random" or creative ideas in science.
- ping00 5y agoWould you mind sharing the author's name as well please? I'm interested in checking this book out.
- xor99 5y agohttps://en.wikipedia.org/wiki/The_Body_Electric_(book) https://en.wikipedia.org/wiki/The_Body_Electric_(book) This one, the main relevance is that the author came up against bio and medical establishment that refused to accept even the scientific interest of studying the effect of small voltage profiles/current on tissue and bone growth. One reason was that the main source of info in the mid-20th century was a soviet scientist, but thats definitely not the whole reason as it comes back to debates about vitalism and the role of electricity in bodily functions/philosophy (etc). Theres a whole lot of similar work in studies on bioelectricity at the moment which if successful seems like it could become a dominant approach too lol. Pretty tricky to think about how that process works over decades or hundreds of years.
- findalex 5y ago> Disagreement, the possibility to be stupid and wrong, and the ability to take random choices based on intuition are eliminated when the majority of a field acts like scientific managers. How do we democratize physical sciences in the same way as CS? My bet would be on the combination of the two (simulation) and providing the high-level tools to the masses.
- supernovae 5y agoNo, it isn't waning. There are struggles, but that doesn't mean its waning. We're having massive progress in medicine, space, cosmology, environment, biology, food, transportation. Hell, the only thing that's waning is public perception of science and that seems to be a deliberate political attack.
- ClumsyPilot 5y agoI think it's obviously waning if you look at any field that deals with physical world: a car from 1940 looks totally different than one from 1980's, but the one from 2020 and 1980 looks almost the same. Space rockets are same as they were in 80's, where are nuclear engines, fusion propultion, etc? Its the same for airplanes, appliances, and everything execept computers. https://twitter.com/Snowden/status/1451342274667876353?t=RO7_VrhNEv7nPFCPc20XSQ&s=19 https://twitter.com/Snowden/status/1451342274667876353?t=RO7...
- walls 5y agoCars, planes, and rockets all have optimal shapes for their environment, of course they're not going to change much once they get to that point. Cars are still vastly different today than in the 80s in (at least) performance, efficiency, and safety. Planes are also getting quite a bit better, although adoption of these planes is slow as most airlines want to get as much as they can out of the old fleet.[0] SpaceX has been landing their rockets for several years now, and are about to take an even bigger step with Starship. [0]: https://www.youtube.com/watch?v=lapFQl6RezA https://www.youtube.com/watch?v=lapFQl6RezA
- f6v 5y agoI was watching the Boardwalk Empire not so long ago. When the main character was a boy, people were wearing fancy clothes, sending letters, and riding horses. As a grown man, he talked on the phone and flew a plane. Whereas my parents were flying planes when they were young. I fly almost the same planes(yes, more safe and efficient) and it takes the same time to get from A to B.
- Tuk9 5y agoJust move to China. Dysfunction in the US has no fix in sight.
- hypertexthero 5y ago[flagged]
- cblconfederate 5y agoThat law is as unscientific as can be. In fact the very wiki article says that it has been empirically disproven.
- cblconfederate 5y agoFirst you shouldnt define scientific progress via academic progress.
- api 5y agoThis is not a question that would be answerable until at least 50 years from now. Discoveries that seem inconsequential are often profound, and vice versa. Rise and decline of large scale human efforts and societies is generally only visible in retrospect. A good chunk of the people in any golden age think they are in a dark age or that doom is on the immediate horizon.
- citizenpaul 5y agoThe entire college phd system is toxic and self serving. At my local college the guy the physic department building was named after was obsessed with some weird thing that no one understood and when he died they just mothballed all his "projects" equipment. No one had any idea what it was or what to do with it and it filled a good part of the building. He was not easy to get along with and shot down anything that he didn't like without even discussion. I'm told this is not in any way uncommon in the field.
- YetAnotherNick 5y agoI am not in favour of naming people, but in case of academics I think senior professor is something like being an employer. It's not going to change when people see it as a distant example. You could say I don't understand the method of this person and don't like his/her approach.
- ren_engineer 5y agoAcademia now selects for people who are good at navigating bureaucracy and getting research funding rather than people who are good at doing actual research
- crazy_horse 5y agoWhat kind of comments does HN select for?
- 323 5y agoThe kind which agree with the HN group think - "nuclear energy is good", "Electron is bad", "Chrome is good", oh wait, that was 2009 HN group think, today is "Chrome is bad".
- Ensorceled 5y agoWait, nuclear energy is actually bad and electron is actually good? What is your reasoning behind nuclear energy is bad? Asking as a Canadian who gets 60% of their power needs met by Candu reactors.
- PaulHoule 5y agoOne thing obvious is the breakdown between theory and experiment in physics. Newton's great accomplishment was discovering a link between terrestrial and extraterrestrial physics. Today on the large scale we see it takes multiple kinds of "dark matter" to explain the rotation of galaxies, structure of galaxy clusters, and cosmology. "Dark matter" evades any attempt to detect it on Earth. Einstein's prediction of how light was bent in gravitational fields was tested by Sir Arthur Eddington in a few years. Last year observational evidence was found for a circa-1980 theory of black hole jets. Neutrino Oscillations were detected in 1998 and have been one of the few areas where particle accelerators get non-null results; the theory for that was developed in 1957 by an Italian physicist who defected to the Soviet Union. (No Nobel Prize!) Since the gap between theory and confirmation of the theory could span a whole career, young physicists need to survive by pleasing their elders with fashionable theories for a decade without any feedback from the physical universe. A strange counterexample was the 1980 rise of inflationary cosmology, where the problem and solution were discovered together. (Somehow nobody was bothered by the "Horizon Problem" until then.) It was Alan Guth's answer to survival in the physics hiring drought of his time.
- kloch 5y agoI don't understand why consensus jumped to the conclusion that there must be a new form of undetectable matter instead trying to figure out what we don't know about gravity. Theoretical particle physics is even worse. There haven't been any advances since the 1970's. Experimental particle physics has done a great job in verifying/testing the predictions from the 1960's/1970's but theoretical physicists are stuck in a rut.
- PaulHoule 5y agoMy immediate take on "dark matter" was that there is something strange about gravity and inertia. At the galactic level, however, there is a lot of cases where it seems you can see the mass distribution of dark matter. They've found starless hydrogen clouds that seem to be dragged around by a dark matter halo. If you think about the evidence from galactic rotation curves you are likely to think that "this galaxy has some dark matter in it" but the modern point of view (which seems to work) is that "this dark matter has a galaxy in it." When it comes to cosmology at the larger scales I don't really believe in the "multiple flavors of dark matter and dark energy" that is fashionable now. I wonder, for one thing, if the universe is really homogeneous at large scales and if that breaks the assumptions of current models.
- ThePhysicist 5y agoThere are probably 100 times more scientists doing research than in the 1920's and the technological means for research are incomparably more advanced, so in that regard we're definitely moving at a much faster pace. Progress in fields like physics is definitely more incremental though as compared to e.g. the first half of the last century when the foundations of modern physics were laid (quantum mechanis, special and general relativity, quantum field theory, ...). Then again, there are many "small" cracks that start showing up in various theories (dark matter & dark energy being one), so I hope we'll soon discover something as groundbreaking as general relativity or quantum mechanics that explains some of them and makes the universe even more interesting.
- merpnderp 5y agoBut what about the replication crisis? Was there such a crisis in the 1920's? Because the motivations for things like p-hacking all point at something broken in science.
- dredmorbius 5y agoIf one wants to limit focus only to the field of psychology, there's been a very long history of exceedingly flawed theory and experimentation, dating to the 19th century.
- YetAnotherNick 5y agoBack then we didn't need replication. If Freud approved it, it was correct. BTW this is only half joke. He is still the most cited researcher ever.
- dahart 5y agoThe same is true in software. The first people in a company or on a project have by far the biggest impact on the structure and future of the software. People who join much later focus on smaller parts, and they might even be geniuses and coding superstars, but they will (naturally) work harder for narrower reasons on a smaller part of the project, relative to the whole. Papers in established fields naturally have narrower and more specific, i.e., smaller impact over time because most papers are fine-tuning things, asking smaller questions, and not building brand new theories or frameworks from the ground up. It’s expected that Newtonian physics is not going to be re-invented every year, right? Newton did it, and now the questions left are how gravity works at scales and speeds we can’t observe everyday on earth. Nobody will ever supplant Newton, because he was first. I’ve watched this happen in my own field, computer graphics. The early papers that have lasting impact are the ones that were inventing the field and laying the frameworks for how to think about it. The rendering equation, the shadow map and Phong shading are ideas that wouldn’t get published today, however they were pioneering at the time. Now the questions we have are about things like what is the true microfiber surface shape of human hair strands, so that we can increase realism by 1% compared to the previous hair models. If you compare them side by side in the context of today, increasing realism of hair shading is a more difficult question to answer than the earlier question of how to interpolate a shading normal across a triangle. So, yes scientific progress is waning in the sense that we’re inventing fewer fields and fewer new theories. There are fewer papers that are expected to be or even trying to be foundational, because the foundations already exist. And it’s not waning in the sense that scientific output has never been higher, and today’s papers are answering harder (and more specific) questions.
- gameswithgo 5y agoIf you consider the set of all things to be learned. Some of those things will be easier to learn than others. Any intelligence setting itself to the task of learning things from this set is going to learn the easier things first. For a time, the power gained from learning early easy things may allow you to accelerate the rate of learning. But eventually you will hit a point where the things left to learn are so hard to learn, that the rate will start to decline. This does not imply something is wrong with our approach now, or wrong with people now. It is a natural and unavoidable thing, that the rate must at some point slow. Newtonian mechanics is incredibly simple to figure out, as evidenced by multiple people working it out about as soon as the tools were there to do so. General relatively quite a bit harder and more complex. Whatever rules tie the quantum world to general relatively appears to be trickier still. Hopefully we get there some day.
- crmd 5y agoI enjoyed this podcast[0] with Peter Thiel and Eric Weinstein, where one of their central discussion points is the current stagnation of technological innovation, beginning in the mid 1970s, with the sole exception of computer software. [0] https://youtu.be/nM9f0W2KD5s https://youtu.be/nM9f0W2KD5s
- thegreatdukd 5y agoPeter Thiel aka Computer Software businessman and Eric Weinstein aka theoretical mathematician and his pal in software business. Like they know anything about the technological innovation, outside of computer software.
- nedrylandJP 5y agoIf it's still going "BOINK"... then we're good. https://www.goodreads.com/book/show/70488 https://www.goodreads.com/book/show/70488
- surajs 5y agonah, just humanity
- rcpt 5y ago> When the rare paper does break through, it usually does so in less than 12 months, suggesting that popularity comes from social media, news coverage, or via existing networks of people who are already well-connected in the subject area—rather than from citations in other work I buy ads for one of my papers. Only a few dollars per month but I like to think it's worth it
- abrichr 5y agoFascinating. If I understand correctly, you are saying that you buy paid advertising for academic papers that you have authored, is that right? Can you please elaborate? e.g. what platforms do you use, which keywords / audiences are you targeting?
- rcpt 5y agoI buy ads to the arxiv link to a paper I wrote. I tried Twitter (the paper is about Twitter) but seems like the minimum spend is $50 per day. Also got the feeling that they weren't targeted enough based on who followed me. I've had a small promo running on Google search ads for a few years (disclaimer I now work at Google). The keywords are roughly what's in the title. I don't know if it's leading to citations. I don't know if anyone else has done this.
- deleted 5y ago[deleted]
- photochemsyn 5y agoIt's worth noting that scientific progress in the Soviet Union seriously stagnated in the Lysenko era due to the prioritization of ideology and the destruction of independent science. I'd argue we are seeing the same thing in many western countries, especially the USA, under the ideology of corporate control of academic research. Much can be traced back to Bayh-Dole legislation in the 1980s, which allowed universities to exclusively license patents (which had been developed with taxpayer money) to private entities. This created a new system of control and influence in academics, i.e. the Intellectual Property Office. What it really represented was the offloading of R & D burdens from the private sector to the public sector, while retaining private control of the patents generated in the public sector. This means academic scientists in the USA today labor under the constraints imposed by large profit-minded corporations, just as academic scientists in the Soviet Union labored under constraints imposed by communist ideologues. This is clearly seen in the pharmaceutical and medical sectors, where research into treatments for conditions is limited to patentable drugs only, older out-of-patent drugs are seen as unprofitable even if they're show to be effective treatments for off-label conditions. Another good example is the elimination of R&D programs for renewable energy by the state; as fossil fuel interests infiltrated government and exerted regulatory capture at institituions like the Department of Energy, solar R&D programs in the USA were basically eliminated in the 1980s and 1990s (leading countries like China, Germany and Japan to become the world leaders). There was also the gutting of environment pollution research that used to be funded by USGS, again due to regulatory capture and threats to deny funding in the 1990s. Basically, the new ideology in American science institutions seems to be 'only do research into subjects that can generate profits for our corporate sponsors', much as it was in the Soviet Union, where the line was 'only do research whose conclusions support the communist ideology'.
- howmayiannoyyou 5y agoExcellent observation apart from the profit-minded corporations bit. Corporate R&D spending has greatly increased, while USGOV spending has remained mostly flat. https://www.stlouisfed.org/on-the-economy/2018/may/rd-business-spending-up-government-spending-flat https://www.stlouisfed.org/on-the-economy/2018/may/rd-busine...
- fallingfrog 5y agoI think there are a lot of major, groundbreaking discoveries ahead of us in fields like biology and applied physics. I think it's plausible that we may be able to cure aging in our lifetimes. I think that we're going to see breakthrough discoveries in socioeconomics and anthropology too. With that said, you can only discover electrons once. The last new particle discovered was the Higgs Boson, and what are the practical applications of the Higgs? Nothing compared with the practical applications of the electron. So, waning? Probably not, at least, not yet. But, we are getting out into the branches of science and not working on the roots anymore.
- BlueTie 5y agoUnderstandability is waning. Which in many places amounts to the same thing. Newtonian physics could be understood by an average child. General Relativity could be understood by intellectuals somewhat. The cutting edge of physics now is barely understood by the people who are publishing the papers. For additional progress to continue in a lot of fields we're giving up a lot of understanding. If we give a mouse a maze that requires understanding of calculus or trigonometry to get to the cheese - the mouse just won't get there. Doesn't matter how many attempts we give it - the reasoning is beyond its capacity. Why would humans be any different to our own upper limits of understanding? (mostly stolen from a chomsky lecture called "the ghost and the machine")
- dilawar 5y agoThis. I don't even bother to read physics article in quanta anymore. I won't compare some theories to astrology but if someone does, I won't run to defend either. I struggle with thwir math articles, but I know that if I find time on weekend, I'll get the theorem (may not be the proof). Knuth books feels the same. Hard reading but rewarding. Biology is always pleasing to read. CS is my bread and butter so I usually bookmark them. PS: Masters in electrical engineering and PhD in system biology.
- mrjangles 5y agoAs a general rule, if you are hearing about some scientific endeavor in the popular press, it is because that science isn't very important, and they need publicity to get funding. What a lot of people don't understand is that there is actually a lot of real science going on in physics. There are two branches of physics, what you call condensed matter / atom optics. And then there is Cosmology / High energy physics. condensed matter / atom optics is where the real science is happening, and those who work in those areas consider the second group to be an absolute joke. The thing is, there is also a feeling of everyone working together to try to get as much money from the government as possible, which is why no one blows the whistle on what a complete scam cosmology and the like is. It is understood at a subconscious level that everyone could be hurt if academics start in fighting, and people would be ostracized for doing it. Also, there are a lot of bad scientists / zealots in condensed matter/ atom optics just as there is in cosmology, and they would try to ruin anyone who said a bad word about the church of academia. Anyway, as far as real physics goes, there was great article on here a while back about how we finally got to look at the atomic structure of glass, and how we can finally try to work out how it is put together. No one knows how glass is put together, there are a number of different theories, and none of them agree. That is the absolute peek of human achievement in science right now, trying to understand how things like glass are put together. So if someone tries to tell you they know how the universe was formed and all of creation came about, but they can't explain to you how that window next to them works, then they are clearly a crackpot, not a scientist. The most hilarious part is that if you pull them up on it they will say "Oh well you see the whole creation of the universe and everything in it is actually much less complicated than glass, so that is why we can get results in this area easier".
- howmayiannoyyou 5y agoEmphatically not in global terms, but probably so in the United States. Diffuse national priorities since 2000 have misallocated academic research, corporate R&D and government investment from hard-science to social science. Also, the inverse relationship between the "financialization" of the US economy & the decline of applied science innovation is stunning. By way of example, applied sciences have lost a lot of talent to fintech jobs. Similarly, the US-Russia cold war, for all its many downsides, did drive applied research. 20 years or so of low-intensity conflict in the ME wasted vast amounts of capital on logistics, munitions and purchased alliances that would have otherwise found its way to various DOD research programs.
- mjburgess 5y agoIt's my view that most unexplained areas today are chaotic systems where reductionism fails: brain-body, ecological systems, etc. Even, i think, extremely fundamental physics. I have the sense that "robust" science doesnt work here: the "explanation" is precisely the irreducible chaos. There isn't much more to be said than to point.
- zwieback 5y agoI think we're just seeing a sector getting used to a systemic shift from for-profit vetting by name brand publications and universities to a freer publication system with lower average quality. As an engineer I'm a consumer of science publications and the way I get what I need has definitely been affected by this. We'll figure it out eventually.
- tpoacher 5y agoMy view is that, like many other fields (including notably software engineering) before it, Academia has fallen victim to Goodhart/Campbell's law. Goodhart's law is an adage named after economist Charles Goodhart: "When a measure becomes a target, it ceases to be a good measure." This follows from individuals trying to anticipate the effect of a policy and then taking actions which alter its outcome. Campbell's law (by Donald T. Campbell, a psychologist and social scientist), is similar, but has a more concrete focus on the predictably negative unintended consequences of using such indicators for decision / policy making: "The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor." For example, how schools evaluated by marks end up 'teaching to the test' or outright help children cheat. A simple combination of the two (to misuse Donald trump style) basically would say that using metrics: sounds good, doesn't work; worse still, it backfires. Goodhart's law focuses on the fact that metrics don't work; Campbell's on the fact that they tend to backfire. We have seen this time and time again in software engineering, when managers try to use crap like LOC metrics, or more recently "slack activity" to judge the quality of a software engineer. Academia is now experiencing its own version of Goodhart/Campbell's law. Between impact factors, h-indices, and now REF exercises, scientific progress is but an afterthought, and the system self-selects either those with a high ability of navigating this monstrous maze of inane metrics created by bureaucrats, or those with the ability to successfully commit academic dishonesty (p-hacking, optimal division of publication units etc) without getting caught, or both. And only extremely occasionally, people with truly novel ideas and output, which happen to somehow still manage to obtain funding despite not fitting into any of the tight little checkboxes that need to be ticked to get a grant on the latest grant-bandwagon.
- blt 5y agoWhat is a REF exercise?
- tpoacher 5y agoAh it's a UK thing. Not sure what kind of equivalents other countries have, but I'm sure they do in similar forms. It stands for Research Excellence Framework, and effectively it's a metric used by government and research councils to allocate funding to more 'deserving' universities / groups, by rewarding departments with "high quality paper outputs". This has led to effectively departments launching tedious bureaucratic exercises and workshops where all members of staff need to submit summaries for "star-ratings" for departmental sifting, submissions of only certain kinds of papers to particular journals, eschewing both high-risk and low-hanging-fruit research in favour of controversial or 'popular' topics which are more likely to gather citations, "buying" researchers for their paper co-authorships within the currently valid REF-cycle rather than based on their research/teaching skills or interests, etc.
- mmmBacon 5y agoThe nature of scientific progress isn’t linear so it’s entirely possible that progress is slowing down. I’m not sure how you’d quantify scientific progress though. If you’ve not read Thomas Kuhn’s Structure of Scientific Revolutions, I highly recommend it because it lays out how science progresses. If you think about it, most of our current technology stems from late 19th Century and early/mid 20th Century science. There are exceptions and different disciplines experience revolutions perhaps at different rates. I don’t know much about biological science but CRISPR comes to mind in that regard.
- 6gvONxR4sf7o 5y agoHey dang, can we change the title to the full article's title? It's: > Is scientific progress waning? Too many new papers may mean novel ideas rarely rack up citations The current title ("Is scientific progress waning?") is so clickbait that it's just getting people reacting to the question instead of the study.
- dredmorbius 5y agoThis article and the HN discussion (as I write this) themselves illustrate a major component of the problem, with rich irony. The full title of the article is "Is scientific progress waning? Too many new papers may mean novel ideas rarely rack up citations". As submitted, the first, generic, clause was chosen. The second, more specific clause, might at least tip off readers that there's something more afoot. The article narrowly addresses a specific premise: "There are so many papers coming out in the largest fields of science that new ideas can’t get a foothold". And indeed, that notion itself has failed to gain a foothold in the ensuing HN discussion. Instead, I see numerous threads in which some popular narrative, many with merits, but not specific to the contents of the article itself are being advanced and discussed. (There are a few notable exceptions, of course.) As the article notes, even within single disciplines, there may be well over 100,000 articles published. No single researcher within a field can even keep up with the titles* published on a daily basis, along with their other research loads. As an empirical validation of this, I'll point to numerous instances of high-volume data assessment: - The New York Times content-moderation desk manages a sustained rate of about 700--800 comments moderated per moderator per day. - Facebook's content moderation data suggest similar rates. - Data by Stephen Wolfram ("quantified life") and Walt Mossberg (general interivews) suggest that people can handle a peak of about 100--300 email messages of any significance and complexity, per day. At 100,000 articles/day, a researcher would be faced with 235 titles per day, every day, 7 days a week, 365 days per year. This raises a few questions: - Are all papers actually "paper-worthy"? (With apologies to Elaine of Seinfeld: https://yewtu.be/watch?v=gfDyOyrY-zM https://yewtu.be/watch?v=gfDyOyrY-zM) - What is driving publication of papers? Is it advancement of knowledge or gatekeeping functions within institutions and disciplines? - What methods for capturing useful and valid information should be applied in cases of information overload? I've argued for years that in such cases, selection is less of a concern than rapid, low-cost, and unbiased elimination. That is, it's essential to discard information which cannot be usefully utilised and which will in fact impair the ability to process relevant available information. - There's the meta-question (addressed by most comments so far on this thread) of what the limits and value, or even definition of science are. Whilst that's an interesting question of itself, and should probably have its own conversation, it's the least part of this specific article's merits. Note that HN itself faces this issue, with numerous submissions daily, of which about 30 count as having made the front page. I'm increasingly going through the "Past" or "Front" links to find what's been curated on a given, or using Algolia to search for the top submissions for a given week, month, or year. That last is somewhat awkward where the immediate prior interval isn't selected, but illuminating. Rates of progress and/or stasis, as well as tropes and remarkable incidents, become much clearer when aggregated.
- mjreacher 5y agoOn the topic of progress in science I personally believe that fields where computation is useful/important (such as biology, chemistry, etc) will continue to progress without much issue, as computation for now at least is continuing to grow without much issue itself, and as it grows it will take at least some time for the appropriate computational methods to be developed. However for other fields where computational resources may not have as much significance (such as theoretical particle physics) I can see that stagnation may be an issue. As many other commentators have noted there are lots of problems in academia to do with funding and how ideas are spread, etc, however these problems seem to be fundamentally economic or political in nature, so just throwing more bodies/scientists at the problem will not resolve them, therefore there must be systematic change from the economic/political sides to improve the situation. Another thing that pops into mind is in regards to low hanging fruit. An obvious solution to why progress may be waning in fields where computation is not important is that all the easy work has already been done (see Dirac's quote about 2nd rate physicists doing 1st rate work in the late 1920s with QM) and thus in order for there to be progress 1) students must have significantly more background knowledge as they need to know more about what does or doesn't work 2) creative ideas should not be shunned 1) imo is already a bit of a problem and I guess at one point in the future there may be issues once humans reach limits to how much their can learn in a certain time but for now this can be mitigated by being more efficient in how students are taught. For example in my own personal experience in math once you get to PhD/research level topics nobody reads textbooks to gain broad knowledge on a topic but rather reads them for reference. There's just too much to learn and know so instead if you're researching some topic you try learn whatever you need as you go rather than from a bottom up approach. 2) is linked to the problems in academia as I mentioned but I guess as more technologically advanced societies should have the advantage over less technologically advanced ones and science is of course basically a prerequisite for technology advances then this problem will solve itself natural selection style. One other thing I would like to note about academia with regards to inefficiencies is how much is still locked away behind paywalls or other inefficiencies due to decentralization. For example lots of historical journals I've seen that only have the content in a certain language, etc things like that. For the scientist and for anyone in general interested in science it would be easier if there was just a central place to look for topics that would include all historical content in some common language so it would be easily accessible. An example again from math is me having information in a Hungarian journal that no longer exists. Not only is the information behind a paywall but also it was in Hungarian and only photo scans so I had to OCR it myself. This is an example of an inefficiency and I doubt most would go as far as I did to find that information, so potentially you have huge quantities of information that may be lost unless it is cited by modern literature on the topic, which is not always the case.
- screye 5y agoImo, it has to do with incentives and rewards.(in CS at the very least) The Hindex is a measure thats become the target. So 1 seminal paper is much much worse than 10 completely forgettable papers. It is also common to divide seminal work into smaller publishable morsels to rack up the hindex at the cost of novelty and clarity. The lack of incentive to pursue novel works, also means that most papers are incremental by design. Imo, this is the biggest waste of money at academic phd programs. However, the students need to take their career somewhere, so an uncomfortable compromise is met. Another problem is how every conference is converging into the same impact maximizing mush without any meaningful differences between them. This has massively affected searchability, which as we know leads to even greater 'agglomeration at the top'. Having different standards for novelty, experimental rigor, math rigor, scale, technical fit and the like would allow for accepted papers to follow internally consistent searchable constraints, while the diversity of target audiences accross conferences would allow for different types of research to coexist. In my field, conferences are only differentiated by deadlines and status. Everything else is secondary.There arent too many papers. There just that the quality of curation has gone to shit.
- carbocation 5y agoIt's painful because (IMHO) the H index is just a much worse approximation of something that we could actually achieve with PageRank for academic citations. In that case, a bunch of middling papers would be rewarded, but so too would one critical paper that lays a foundation for a field.
- prionassembly 5y agoWouldn't betwenness centrality be better? Think of an army randomly moving through your citation graph; the more particularly nodes are trampled over, the more pagerank it has. Now: if this army is informed about the shortest routes and instead moves about optimally, the most-trampled over places have higher betweenness centrality. I'd like my simulated citing scientist to be smart.
- carbocation 5y ago
- mistrial9 5y agoI read some machine learning research papers among others. The explosion of papers from chee-na, at all quality levels, at orders of magnitude more than a year before.. was/is hard to deal with for me
- zibzab 5y agoCare to elaborate why?
- laichzeit0 5y agoIt’s becoming increasing difficult to cite the correct Li, Wang and Zhang paper in LaTeX.
- conformist 5y agoFrom the study's abstract: "The deluge of new papers may deprive reviewers and readers the cognitive slack required to fully recognize and understand novel ideas. Competition among many new ideas may prevent the gradual accumulation of focused attention on a promising new idea." - This appears to be a key problem in academic research that matches my personal experience. More papers with less novelty are not only not beneficial, but beyond some point they become a net tax on everyone in the field. Without innovative approaches to fix the incentive structure of modern science, this is going to get worse over time. Are there any obvious solutions aside from "hacks" such as e.g. private foundations flooding specific fields with cash to reduce the need to publish?
- fouc 5y agoIt could be handy to have some sort of novelty scoring mechanism.
- ColinWright 5y agoAlso discussed at considerable length here: https://news.ycombinator.com/item?id=28821498 https://news.ycombinator.com/item?id=28821498 (different write-up, same problem)
- tonmoy 5y agoAh. That explains the stagnation in fields like molecular biology and electrical engineering /s
- civilized 5y agoMore empty "paradox of choice" cliches. It's not that we have too many choices, it's that our many choices are a sea of crap, we know it, and there's no way to find one good thing in ten thousand craps.
- TuLithu 5y agoThis definitely also applies to the realm of programming languages. Clear back in the 1990s, Richard Hamming said that we used to stand on the shoulders of giants, but today we stand on each other's feet.
- Ericson2314 5y agoWe needs fewer PhD candidates, and more auxiliary roles. Pay people to work on wikis — ever field needs an n-lab. Pay people to work on open source software, and distros. Pay people to develop existing research independent of their being enough demand (because Say's law is not a thing — monetarily) Confining the academy to the R of R&D kills virtuous cycles and saps productivity as no one can take risks to improve the process separate from chasing outcomes.
- lincpa 5y agoThe Grand Unified Programming Theory: The Pure Function Pipeline Data Flow with Principle-based Warehouse/Workshop Model My theory based on the simple, classic, vivid, and widely used in social production practice, elementary school mathematics "water input/output of the pool" as a mathematical prototype, Therefore, it is scientific. The "von Neumann architecture" and "programming paradigms" used by computers now has no mathematical model support. So it cannot prove its scientificity. My theory rebuilt the theoretical foundation of the IT industry, The IT industry is fundamentally associated with mathematics. Solved the most fundamental and core major problems in the IT industry. Therefore, my "warehouse/workshop model" will surely replace the "von Neumann architecture" and other "programming paradigms", become the first architecture in the computer field, and it is the first architecture to achieve a unified software and hardware. Software and hardware are factories that manufacture data, so they have the same "warehouse/workshop model" and management methods as the manufacturing industry. In the IT field, only it and binary system fully comply with these 5 aesthetics: Simplicity, Unity, order, symmetry and definiteness. It has a wide range of applications, from SOC to supercomputer, from software to hardware, from stand-alone to network, from application layer to system layer, from single thread to distributed, from general programming to explainable AI, from manufacturing industry to IT industry, from energy to finance, from the missile's "Fire-and-Forget" technology to Boeing aircraft pulse production line technology, from myth to Transformers. Link: [The Grand Unified Programming Theory: The Pure Function Pipeline Data Flow with Principle-based Warehouse/Workshop Model](https://github.com/linpengcheng/PurefunctionPipelineDataflow https://github.com/linpengcheng/PurefunctionPipelineDataflow)
- amai 5y agoThe signal vs. noise ratio must become much worse by so many new papers.