8 ms·
An invitation to a secret society
- genmud 3y agoOne of the biggest issues we have to solve is the indexing and verification of knowledge. This is where I hope AI and ML will go, but being able to say whether the data is unique or derived from another source and being able to catalog it is something that is entirely lacking. Right now there is just too much shit out there and it’s difficult to know what the context is for it.
- b_emery 3y agoI slightly disagree - it's the verification and integration of knowledge. The integration part - that is, reading papers and assessing them compared to all the others you've read, is quite hard, but it performs the useful function of creating a weighted average in your mind of what is real, and where the boundary is. This is part of graduate training, but it's basically what review papers do, so there is a time lag built in. AI for this would be huge, and it seems like it's not far off. And I want it to cite sources and point me to the real references, please.
- genmud 3y agoWhile I totally get where you are coming from, I don’t think integration is necessary in 99% of usage. Sure, it helps people build intuition in the field they are specializing in, and for those people it can be invaluable, but having a better way to recall things would solve most use cases. IMHO the biggest disservice to students in much of the education system in the US (including some colleges and universities ) is the focus on memorization vs focusing on problem solving. The older I get, the more I reflect on how much opportunity was wasted with poor quality teachers who just wanted us to memorize facts and be able to reproduce those facts in tests. I don’t need to memorize maxwells equations to know that they exist, what they focus on, or how they can be applied to certain problem sets.
- RobotToaster 3y ago"Science is the Belief in the Ignorance of the Experts" - Richard Feynman
- Lanz 3y agoThis is an incredibly important idea. The scientific process has been corrupted by far too much pseudoscience and not near enough actual science. If the data say you are wrong, you are wrong. That doesn't mean finagle the data until you get the result you want, perform endless subgroup analyses, etc. If a theory is wrong, throw it out and start again. Quit salvaging the corpse of broken theory.
- asynchronous 3y agoI’ve read some Abstract conclusions in the last couple years that are so blatantly trying to fit their data result into some preconceived scheme from their hypothesis it’s laughable.
- tgv 3y agoDid you ever do academic research in one of the softer disciplines? Because it sounds like you didn't. I'm pretty critical of psychology (worked in neuro/cogsci for about 18 years). I reckon 95% of its output is wrong. But that's not because of pseudo-science. All theories in psychology are wrong. We've got no idea how the brain/mind works. All we can do is try to make sense of the experimental data that's available, come up with an idea that appears slightly better or has a different angle, contrast it with competing ideas in the same area, and keep defending it until it's utterly destroyed. If you would follow your rather rigid process, theorizing, and consequently experimenting, would stop overnight. It's not the way out of the swamp. That also means that we should not use psychological theory as evidence for anything, and certainly not for policy making. Some of the applied research can be used though, if it's been established properly and repeatedly (another weakness in much of the social sciences).
- edgyquant 3y agoWeird how you say it isn’t pseudoscience and then spend two paragraphs describing why you think it is pseudoscience
- biomcgary 3y agoIn many ways, I like the spirit of this post. I've tried a bit of it myself, since I'm interested in questions that aren't easily packaged for a grant (in the current era/error). BUT: "And second, for the first time in human history, the tools of science are cheap, and knowledge is nearly free. Your laptop can store and analyze more data than Galileo could have even imagined." A big chunk of the problem in biology is with the data being collected. Garbage in, garbage out. If you aren't running real experiments, not just pushing bytes around, you are unlikely to find something truly novel. (I say this as a computational biologist who pushes lots of bytes around.) Good luck affording modern tools and data collection on your own dime. The bar for new discoveries is simply higher than the past. ARPA-H (DARPA for healthcare) was recently established, which will be interesting to watch. However, I'm pessimistic that anything will significantly change until the current system crashes and burns under its own weight. Nevertheless, incremental progress is still happening in biology even if it lacks elegance and involves a lot of missteps. Some of it even makes it to the real world (e.g., current trends in cancer survival rates).
- musicale 3y ago> the tools of science are cheap More accessible, but not always cheap. Still a lot of expensive equipment involved in particle physics, nanotechnology, astronomy, etc. Training large AI models is still expensive and requires tons of data. And medical research still requires expensive clinical trials. And of course if you're not getting paid to do science then you probably need income from somewhere else.
- bentoniteclay 3y agoI'm curious what your thoughts are on iNaturalist, as a computational biologist. I'm a frequent user of that platform and I often wonder about the biases involved with user-generated content like that (people probably have a higher propensity to upload observations of flowering plants than they do of ferns, or bacteria, etc.). So I guess I wonder: is it a common resource for a computational biologist (or similar), or is it just considered a source of mostly garbage data?
- a_bonobo 3y ago
- dt3ft 3y agoThis crazy thought keeps haunting me: > The simplest generator consists of just a coil of wire and a bar magnet. When you push the magnet through the middle of the coil, an electric current is produced in the wire. Here is the crazy thought: What if we took other materials and tried using it the same way as the generator? Does that produce another form of energy (not electric current) but something totally different which we can’t even detect? What’s to say that only electric current can be generated but some other forms of energy too? What happens if we push a crystal through the coil? A rock which isn’t magnetic? A piece of wood? What effect does that have on atomic scale that we can’t even detect or measure?
- xenadu02 3y agoYou can't just say "other forms of energy". That's a massive hand-wave. The electromagnetic field can be detected and manipulated experimentally. It also has reasonable theories of explanation and mathematics to describe its function. The theories made predictions that we later verified with experiments (meaning the theories were not just post-hoc descriptions). A magnet is not special; it is just a material where lots of the magnetic domains are aligned in the same direction such that the overall magnetic field doesn't cancel to zero at a distance. Not all molecules have much of a magnetic moment themselves either so even if they were to align that doesn't mean they'd exhibit much of an overall field. Water falls into this bucket. It takes super strong magnets and super sensitive detectors to make MRIs work precisely because water's ability to be magnetized is so insanely small. Also crystal is an arrangement of solid matter, not a thing unto itself. It just means the electromagnetic charges and shape of the molecule make the atoms want to orient in 3d space into a regular pattern. Any molecule that self-organizes into a repeating geometric pattern as it transitions from liquid creates a crystal.
- akomtu 3y agoFwiw, that's the mechanical basis of many rituals and sacraments that one day will be understood by science. For example, the eucharist ceremony is a carefully designed sequence to produce a certain uplifting current, vaguely perceptible in some cases, but not measurable today. For example, we know that there are these weird neutrinos, but if we were to find a method of constraining them within a pipe, the produced current might have unusual properties. Pretty much any foo flowing within another type of foo will create a new type of current.
- motohagiography 3y agoYou inhabit a global economy that was imagined by students in dorm rooms and couch surfing launch failures. Working people today have the wealth and leisure of every single lady and gentleman scientist who has ever made a significant contribution - and we have the sum of human knowledge at our fingertips. You have running water, flushing toilets, and food delivery. The only thing standing in the way is a commitment to curiosity and competence. The beauty of science is it is in the evidence of reproducable experiments. All models are wrong, most theories are bullshit, and the people charged with progressing science for our species learned it in a couple lectures a week over three years or less. You can do valuable and edifying work in less time than it took to fully apprehend the disappointment of the Game of Thrones finale if you'd only watched 3blue1brown videos instead. Prestige is what they offer you when they don't want to pay you what you are worth, and their esteem isn't worth the envy and sabotage it costs. If you are curious about something, find out. The one thing that I can guarantee that is true about this world is that it forgives you when you prevail, and when you fail, nobody cares. I say this to myself as much as anyone.
- holografix 3y agoThat last paragraph. Cuts like a knife
- b_emery 3y agoI was just reading this earlier today: "“Fall in love with some activity, and do it! Nobody ever figures out what life is all about, and it doesn't matter. Explore the world. Nearly everything is really interesting if you go into it deeply enough. Work as hard and as much as you want to on the things you like to do the best. Don't think about what you want to be, but what you want to do. Keep up some kind of a minimum with other things so that society doesn't stop you from doing anything at all.” ― Richard P. Feynman " Regardless of the source, these (and yours in the same vein) are some wonderful ideas.
- dinkleberg 3y agoBeautifully put. These are important reminders.
- godelski 3y ago
- musicale 3y ago> Haven’t all the easy ideas been taken? In certain disciplines (astronomy) the bar seems to have gotten (literally) higher.
- beloch 3y ago>Most of the professional science we produce right now is bad. Seriously, pick a paper at random and see how well it holds up. This is utter BS. Occasionally, a high-profile fraudster is found out, but the overwhelming majority of papers in most disciplines will hold up very well under scrutiny (not that there couldn't be more scrutiny!). Scientists are humans though, and a certain percentage are scumbags. Given how scum rises to the top in private enterprise, I'm actually surprised we don't see more fraud from top administrators at ivy league colleges. Academia has always had to strike a balance between embracing new ideas and resisting quacks. It's not news that revolutionary ideas sometimes have a tough time gaining acceptance. Science provides a framework that makes accepting ideas that work almost inevitable, but sometimes it takes time. Can millions of backyard scientists really move things forward? Only if they're actually scientists in the sense that they keep careful notes and can reproduce their findings. If you find something weird and can't reproduce it, why should anyone take your word for it? Science has to be replicable. You can't have some secret process that only works in your backyard. You need to be able to write down how you produced your result in a way that someone else can read it and then replicate it in their own backyard. Only then can it become useful. Unfortunately, for some areas of science, there are certain requirements that are impossible to meet in your backyard. You can't experiment with creating anti-hydrogen in your backyard because you need a massive particle accelerator for that kind of work. What is most direly needed is better lines of communication between academia and the public. Currently, most university laboratories' communication with the public is carefully managed by PR departments. You don't just talk to anyone you like about your latest work. The PR people must be involved, lest you say something embarrassing or fail to sufficiently puff up the university's image. This needs to end. Scientists are sometimes awkward communicators. Certain words sometimes mean very different things to them. We need to get the public used to letting the occasional gaff slide and we need to get scientists out of the PR hustle sideshow. We need scientists talking directly to the public, explaining what they're doing, and listening to screwball ideas from the peanut gallery. It lets the public know what's being done with their tax dollars and gives amateur scientists a chance to get up to speed on cutting edge research. It also bombards scientists with ideas. Even bad ones can be valuable prods in novel directions. We don't need people saying that academia has failed and it's time for unpaid enthusiasts to pick up the mantle of progress, because that's not true and not how we move forward. We need to bridge the communications gap and unite the creativity of amateurs with the resources of professionals.
- madrox 3y agoWhen I read this post, I imagined the author talking about hard science like physics, chemistry, and other fields that require pretty significant investment in proper tools and a strong understanding of deeply complex topics that have been battle-hardened over decades. I don't think the problem with those fields is that we need more amateur cooks in the kitchen. However, this post was written by a post-doc in social psychology, and is employed in the management division of a business school. I'm ready to believe that a rank amateur could walk into his field and do science just as well as anyone else, and this post makes a lot more sense.
- hooverd 3y agoTurns out it's harder to break into a field when failing means breaking the half million dollar piece of equipment until the vendor can ship out a replacement part!
- r0uv3n 3y agoEven though I disagree with the point of your parent comment, their argument can also be made for mathematics vs social sciences, and those don't differ on how much budget they require.
- iamhamm 3y agoI had a similar thought about the hard sciences (physics graduate dropout) and the inaccessibility of hard sciences to amateurs. Then I moved to the desert and got interested in geology and much to my surprise learned there's all sort of stuff in geology that is available. It's the result of the need to physically go look at rocks (at least for structural). I'm currently working on a new description of the strata at the end of my street because the highest resolution stratigraphic map fails to correctly delineate at least two units of bedrock - eg the map does not show them, but they appear to be present. To figure it out, I've had to take several road trips to compare my neighborhood rock to the exposed units in those locations. I find it quite fun and entertaining. Meanwhile, a colleague of mine found a new species of dinosaur using a radiometric detector he designed and got a patent on (https://ktar.com/story/4298984/arizona-volunteers-unearth-75-million-year-old-dinosaur-in-new-mexico/ https://ktar.com/story/4298984/arizona-volunteers-unearth-75...). There's still some real science out there if you want it. :)
- agnosticmantis 3y agoAs a counterpoint, at least as far as ‘fundamental discoveries’ go, see the article by Sean Carol“ The Laws Underlying The Physics of Everyday Life Are Completely Understood”: https://news.ycombinator.com/item?id=36808614 https://news.ycombinator.com/item?id=36808614 The fundamental stuff are all known, except for the ones you don’t encounter in everyday situations, which will as a consequence be harder for hobbyists to discover too.
- buescher 3y agoThe laws are well understood, but not universally, even among credentialed experts, either. And implications of them remain to be discovered. And on top of that, their predictive power is limited.
- tagami 3y agoI founded a start up that has run 10 missions to space - with an art background. It took the willingness to be most ignorant person in the room, and to be okay with that. We've been able to make it work financially because we engage learners of all ages (K to grey!) around the world that all chip in to make the numbers work. ExoLab-11 is scheduled for 2024. What might we discover together? What should be investigated next? https://magnitude.io https://magnitude.io
- getmeinrn 3y agoReminds me of a Tolkien quote: Evil cannot create anything new, they can only corrupt and ruin what good forces have invented or made.
- paulpauper 3y agooh man, another one of these "science/peer review is broken" type articles. without peer review, you have the equivalent of whatever is popular on twitter or other social media. Or total crap instead of possible crap.... Peer review is far from perfect but the alternative is even worse, imho. I think this is especially so in the hard sciences, but i will concede the point to the author that peer review is not as useful for social sciences as being a firewall against bad/wrong results.
- edgyquant 3y agoConsidering the replication crisis and the revelation that multiple schools have allowed for bogus data to slip through in numerous studies: I don’t see how you can pretend this would be any different than what we have now.
- guidoism 3y agoI love this. One of the ideas I've been noodling around in my head is that we can brute force our way through really difficult problems. There are a lot of fricking people on earth. The biggest companies doing research have what, a couple hundred thousand people? Imagine a 10 million people attempting to solve a single problem. Or a 100 million. Or half a billion people! The one that pops into my mind is climate change. Imagine if we had millions of different experiments going on in parallel and millions of people tinkering on stuff to fix the world.
- melagonster 3y agoif we can let everyone get basic education, this will come true !
- totetsu 3y agohttps://en.wikipedia.org/wiki/File:What_if_it%27s_a_big_hoax_and_we_create_a_better_world_for_nothing%3F.png#/media/File:What_if_it's_a_big_hoax_and_we_create_a_better_world_for_nothing?.png https://en.wikipedia.org/wiki/File:What_if_it%27s_a_big_hoax...
- analognoise 3y agoThere's nobody to talk to. People used to write long letters to each other, consider them deeply, and reply thoroughly. If you could find a small band of people to talk to, and force all communication to be through hand written notes, I think you'd have something. As it is, nobody wants to think deeply about anyone else's problem - they want a quick answer that aligns with the correct one that's in the book. Finding the exact group of people who are amateurs at a similar level who can grow in some subject together sounds great, but I think we'll find this when we get an AI that you can get good answers out of and can send it clippings from a book or newspaper and it will correctly understand the same way a good teacher would.
- slushh 3y ago>Finding the exact group of people who are amateurs at a similar level who can grow in some subject together sounds great, but I think we'll find this when we get an AI This could take another 50 years. I hope that they are successful and that they will grow into a social network for science. It's almost surprising that there is not already something like BookWyrm for subjects and skill levels.
- barryrandall 3y agoThe long letters have become blog posts, YouTube videos, and public social media conversations. Influencer content is usually just infotainment, but scrolling past it can yield some real gems.
- nullc 3y agoIt can be a little disheartening to discover some really obscure thing and then discover that Gauss beat you to it 170 years ago, over and over again. The next problem you get is that increasingly discovery isn't the limiting factor, being able to usefully communicate about a discovery is. You might find all manner of useful stuff, but good luck getting it in front of someone who needs to know it. At least you won't have the weird academic pressures to obfscuate your work to make it sound more complicated when you publish about it, IF you can find a useful way to publish about it.
- kingZion 3y agoInfinite
- stOneskull 3y agoStonecutters
- goddessoflists 3y agoLots of interesting comments reminding me not to side 100% with something just because it was said by someone whose work I love. I have a degree in Applied Psychology so I have some idea about how stuff works, although perhaps not as much as someone who's done a PhD. Mastroianni didn't specify exactly what you should be investigating. Anything that involves hurting others is out of the question, be it medical research or psychological. But I guess there is literally no harm in observing the growth of the plants in your garden, the behaviour of the pigeons that visit your balcony every day, in conducting online surveys to guage attitudes and opinions (as long as the surveys are well-designed, a skill that can be learned online), putting a dead butterfly under a microscope and then sharing what you learned with the world. We can share such "findings" and observations without claiming that our research is on par with those done by professionals. As long as the ones sharing these notes and the ones reading them understand that amateur exploration of an idea isn't a replacement for rigourous research, I see no harm in more people taking notice of the world around them and bringing other people's attention to it. Perhaps one of these amateur observations might be read by a professional, inspiring them to investigate it properly. As for me, I'm thinking of publishing the findings from my dissertation on my blog. I'm not interested in conducting research, but I do enjoy reading research papers and explaining their findings. I guess that counts too.
- soco 3y agoI believe the word you are hinting at is "humble" and there's definitely a lack of it for most of the amateurs doing "their own research".
- janalsncm 3y agoIn my masters degree I took a course where the entirety of the grade was in replicating a machine learning paper. It’s wasn’t a well-known one, but it still had many citations. Well it turns out that the paper leaves out many key details in how it would actually be replicated, and the GitHub link was long since deleted (and not archived either). After many good faith efforts to reproduce the results we realized that the published result was actually probably due to the authors’ choice of a lucky random seed. Or more likely, rerunning the experiment many times with different seeds. In reinforcement learning that’s not uncommon. Even if I am wrong, I still believe that a part of peer review should be in a third party being able to replicate your results, at least in computer science. It’s expensive but imo would lend a lot more credibility to results.
- kmmlng 3y agoI would rather normalize publishing negative results (including refutations of previously published positive results). Reproducing every single submission is extremely expensive, but per the Pareto principle, no one is ever going to care about the vast majority of publications. It's the ones that lots of people care about that we want to be accurate. Given the right incentives and possibilities, people will seek out to reproduce those by themselves.
- amykhar 3y agoI believe amateurs can definitely contribute to science because advancements in knowledge often come from remixing existing ideas or incrementally improving something. I contend that the guy who built obstacle courses for squirrels in his backyard and shared it could be advancing science by inspiring a biologist to explore how animals solve problems. There IS a certain amount of creativity required in science because you have to be able to form a hypothesis. A hypothesis is nothing but an idea - and the best ideas tend to come from people who are exposed to a lot of things that they can draw from.
- throwaway86530 3y agoRegarding how slow academia is adopting open science and other practices that would help fixing the disastrous state of scientific publishing, I am starting to think that forming societies competing with academia has a strong potential to make things change. You can't play with new rules inside a system governed with old rules. I have some skepticism with the approach described in this article, but I applaud the initiative, we need to form strongly cohesive groups that do science with their own term and see what comes up in the end.
- Tepix 3y agoI think scientists can be very helpful in this endeavour by suggesting things that interested amateurs can do. Of course, this doesn't mean they shouldn't do anything else! One example: As a hobby astronomer, i can help advance science by taking measurements. I've found information about this topic to be somewhat difficult to find. There is a telescope which makes it very easy (the Unistellar), but it appears overpriced to me (4500€ for a telescope with a small 114mm mirror!).
- moltar 3y agoI’m a big fan of this approach. Even funded (small donation) one study that was started as a single person studying self, then he replicated on relatives, then online community, and then decided to get a defendable study done and raised funds from the community. It’s truly amazing we can do this. We don’t need to wait for some bureaucrat to approve a study or a donor to give to feel-good cause. It’s like a direct democracy of science funding :)
- xkcd1963 3y agoI have relatives that have inventions but they live in Russia and basically you get nothing in return for patents. How difficult would it be for a foreign citizen to apply for a patent in, lets say, the USA?
- ot1138 3y agoI've been doing this for years on my own and I'm stuck. What's the author's email?
- wslh 3y agoGarbage in, garbage out.
- piokoch 3y agoHowdy, this man is nuts. "Experimental Fat Loss is a pseudonymous blogger who has run lots of self-experiments on weight loss." Seriously, is this something we should promote? Wrong diet can cause severe diseases, physical or mental, pushing someone into anorexia or bulimia.
- nuc1e0n 3y agoIs there any point in inventing something new investing your own time and money if cheap knockoffs can be produced overseas and imported with no consequence? Patents just aren't enforcable in the globalized world of today. Not to mention monopolies stifling potential competitors from arising.