5 ms·
This is especially true in math and physics. You will find that no matter what problem you can think of, either it has already been solved to the highest level
by paulpauper 4y ago
This is especially true in math and physics. You will find that no matter what problem you can think of, either it has already been solved to the highest level of abstraction, or it's an unsolved and famous problem, or not worthwhile/trivial. Like, what about analogous of elliptic functions for non-elliptic integrals? already been done. The past century has seen a huge explosion of research into STEM subjects, from math, to physics, to biology, to computer science, etc.. Tens of billions of people people ever lived since the 1800s, and even just a tiny, tiny fraction of them are doing research, is still a huge amount of output. There just isn't much new ground to break, so this means discoveries will either be much more incremental or require considerably more mental horsepower.
Psychology is sorta the opposite: there is no limit to the number of experiments you can run on people or possible associations between causes and effects. It's not like psychology , literature, philosophy, or history has gotten harder over the past century, unlike math, physics, or economics. Sure, there are more advanced statistical methods, but running experiments hasn't gotten harder. This is also why the vast majority of physicists and mathematicians are teachers rather than researchers, and why econ papers have gotten much longer and are full of dense stats methods. There are always going to be new discoveries in biology and medicine, and same for applied math and applied physics, such as engineering or astronomy, but theoretical math and probably also theoretical physics are as saturated as can be.
- btrettel 4y ago> This is especially true in math and physics. You will find that no matter what problem you can think of, either it has already been solved to the highest level of abstraction, or it's an unsolved and famous problem, or not worthwhile/trivial. This hasn't been my experience in fluid dynamics. There are so many places where one could apply a standard approach that people haven't. It takes some effort and experience to recognize that, but it's still true in my experience. I think what you described is probably true for sexier areas like high-energy physics, but not true for more "boring" areas like turbulent flows. Yes, turbulence is "unsolved", but that doesn't mean that useful information couldn't come from applying standard approaches to particular turbulent flows. The variety of industrially-relevant flows is quite large.
- cycomanic 4y agoI agree with you there are so many areas still vastly unexplored, fluid dynamics or the whole area of complex systems is definitely a prime example. Stephen Hawkins called his inaugural lecture "Is the End in Sight for Theoretical Physics?" suggesting that we are very close to the end of theoretical discoveries. Although less famous I would argue that prediction was just as wrong as "640kB should be enough for everyone", lots of extremely fundamental discoveries had been made since then, and we don't seem to significantly closer to a theory of everything.
- Beldin 4y agoHe discusses in (if memory serves) "A Brief History of Time" whether we will keep on discovering ever-more accurate physical theories, or if there's a theoretical limit. The Planck scale offers a theoretical limit, so there's hope. At any rate, that is how I understood him. Not that we're nearly there, but that our current path of discovery seems finite.
- cycomanic 4y agoTo be honest I have not read his books, but I always had the impression from his talks that he was quite narrow minded in that he largely only meant astro/particle physics when talking about theoretical physics, ignoring many areas in the process. Also worth noting that the book came out 10 years after his lecture, so he probably revised his views during that time.
- laingc 4y agoI think GP is conflating Maths with Pure Maths. While I’m sure there is new ground to break in Pure Maths, I would agree that it’s getting harder and harder. However, as you note, in Applied Maths there are more unsolved problems than you could address with a million researchers. A physicist or pure Mather social looks at Navier-Stokes and says, “Oh, we know how that works, nothing to do there I guess”, whereas the applied mathematician looks at it and goes, “holy cow, this could keep my entire department busy for the rest of our natural lives”.
- mike_hearn 4y agoWell. I wonder. You generalize a bit from maths and physics to all of STEM there, and throw computer science in there too saying there's not too much new ground to break. But that isn't what I see when I survey the CS literature. Instead it feels like important areas get neglected and ignored, whilst enormous herds thunder towards fashionable topics. My guess is this slowdown is happening for a few reasons: 1. Increased number of researchers = increased team size = less innovation. The article shows increase in team size but doesn't ponder the implications. Teams shy away from bold ideas, in my experience. If you want innovation it has to come from individuals empowered to work alone and recruit slowly. The moment you're put in a team situation you are suddenly expected to pitch and convince others to take a risk on an idea that perhaps you aren't even sure about yourself yet, which is a high bar to meet. And the team won't want to try it because if it works the glory will associate with the individual who came up with the idea and drove it forwards, leaving the others in the shade. So teamwork puts pressure on people to propose 'safe' ideas that were found outside the group, which nobody will object to and which everyone can share equally. NB: non tech firms struggle to create new tech partly for this reason. They have a culture of creating so-called innovation teams. This practice is rampant in finance for example. I never saw an innovation team do anything truly surprising. You could always guess up front what topics they'd be "researching" before learning anything about them because the range of topics was so narrow. 2. State subsidies. We know these kill worker efficiency. If that weren't true the USSR would never have fallen behind the USA in terms of wealth. What the article refers to as science is really academia, and academia is dominated by ever increasing amounts of government money. Whilst the article phrases this as science getting "harder" it can also be seen as researchers simply becoming less efficient than they were in the past, which is exactly what we'd expect to happen given that academia is a parallel planned economy. Efficient here means in terms of discovery production not paper production, of course. 3. Falling paper quality. Another way to view (2). I feel like half my HN comments are about this problem these days but the quality of papers in some research fields is staggeringly low, sometimes junk quality. As in, you could throw out 90%+ of the papers and the field would get better not worse. In a few fields like "social bot" research or epidemiology I'd struggle to name any recent papers that weren't intellectually fraudulent in some way. If you join a field as a researcher because you feel like it's an important topic, and then discover that the papers published in the last 10-20 years are much more likely to be non-replicable or have nonsense methodologies than those published 50 years ago, then you'll probably end up reading older papers because you feel you get more out of them. Then you'll end up citing them more often as a result. I definitely feel I saw this when reading the epidemiology literature. Papers from the 1950-1990 period were quite different to modern papers. Way less fancy maths, much easier to read, more obvious and logical questions being asked and no WTF moments. You definitely got a feeling that the authors were intellectually curious and wanted to understand epidemics. From 2000 onwards the papers became nearly always useless. A big part of this is the post-2000s era explosion in the use of advanced statistical methods and, especially, the acceptance of unvalidated models as "science". The creation of free tools like R and STAN made it much easier and so many papers now are just people playing around with R and random arbitrary datasets. They plot some regressions and publish a paper. Unvalidated modelling seems to have destroyed a lot of fields, because to people who are rewarded for publishing it's basically crack cocaine. If your papers have to describe factual things about reality then you're limited in how much you can write about by cost of experimentation, difficulty of discovering new things etc. If your papers can describe arbitrary scenarios invented in a computer with no care given to validity, then those caps are removed and you can publish an infinite number of papers. Yet the actual value of such papers can be zero or lower. So yeah. He shows graphs of discovery fall in exactly the same way across every single field he looks at, whilst output grows exponentially, and then concludes that "science" in general is getting harder. But then that's clearly not been true of some fields like AI lately. It seems more likely that such a strongly correlated trend is caused by structural issues in academia rather than a true general effect.
- xkcd1963 4y agoI would argue psychology is not a science and I'm not alone with that opinion
- abyssin 4y agoIf biology is a science, some part of psychology is science. But I agree with the idea that many things that are called psychology have little to do with science. The first coming to mind is psychoanalysis. As a psychology student, I'm absolutely shocked at how much credit is given to charlatans.
- gspr 4y ago> This is especially true in math and physics. You will find that no matter what problem you can think of, either it has already been solved to the highest level of abstraction, or it's an unsolved and famous problem, or not worthwhile/trivial. I did not experience this in my 8 years in academic math (PhD + postdoc). Maybe it differs a lot from field to field, but mine was positively teeming with unsolved problems. More importantly, it's teeming with paths that will clearly lead to more unsolved problems (of all difficulty and importance levels). In fact, the thing I miss the most from academia is probably helping new students blaze some of those new paths. Both for their sake, and as a way for me to discover new problems for myself.
- kcexn 4y agoIn maths, this does seem very dependent on what work your peers and community recognize as progress. Maybe problems that are more and more trivial should be considered acceptable to publish, simply as being a contribution in filling in gaps. Or maybe the works of many more mathematicians should be tied together in larger contributions. More scientist will mean that overall we have more time to spend in the dusty cobweb filled corners that have yet to be studied in fine detail. And while many of those corners contain nothing interesting. If even one of them contains something truly undiscovered it's worth it right?