6 ms·
I've done an enormous amount of independent (and fairly successful) computer science research over the last two decades. Computer science is amenable to it if y
by jandrewrogers 8y ago
I've done an enormous amount of independent (and fairly successful) computer science research over the last two decades. Computer science is amenable to it if you are willing to make a large investment of time. The challenge is that making this research useful to other people requires an even bigger investment of time, which creates a somewhat adverse incentive.
At least for me, there is one giant gap I've ever never been able to cross. I am willing to spend an inordinate amount of time solving interesting theory problems and doing novel algorithm design work because it is useful to some cutting edge software problem I am working on. However, I have almost zero incentive to spend the significant amount of time to publish any of my research, whereas academics do. My time is enormously oversubscribed as it is. My benefit is that I can reduce it to practice and build software that does things no one else can do (and I enjoy the research generally). I know a few other people in the same boat; great researchers, no time or incentive to publish.
I've never been able to reconcile this. There is a similar analogue in open sourcing software. Open sourcing your software often increases the amount of time you need to invest in it in practice, which disincentives people with limited time to open source code (and after they already invested their extra time creating the code in the first place) that they otherwise would be amenable to open sourcing.
- ssivark 8y agoI think the dissemination part is a collective action problem. Simply put, society has not set up opportunities to induce/encourage researchers outside the academic scaffolding to share their work. Given that, it comes down to a question of who cares most about the dissemination. If neither the person who would be writing, nor the putative audience cares about it enough, who would want to put effort into the dissemination process? Creating such a two-sided market for research output is a hard problem, roughly analogous to what Uber has done for ride-sharing. The current academic/think-tank setup is an intricate triangle consisting of the grant process to match donors with researchers seeking funds, the publication process to match research output to downstream demands, and publication metrics (citation count, reputation, impact factor, etc.) to match downstream demands with funding agencies.
- bbeonx 8y agoYou need grad students to write papers for you...
- woodson 8y agoTeaching them how to write good papers takes way more time than writing papers yourself.
- Xcelerate 8y agoI had this issue during grad school. The research was the fun part. Writing my results up into a paper and formatting it for submission to journals... not as much fun.
- Al-Khwarizmi 8y agoAcademic here. I agree with you, and I think the majority of academics would. After all, most of us get into the field because we like research itself, not because we like writing. But the thing is that research is useless if you don't communicate it. A researcher that doesn't write is like a cook that throws their food directly to the bin, or a singer that only sings in the shower. It's legitimate that they do it for fun, but no one would consider them to be a cook and a singer, or take their work seriously. Anyway, if you had kept doing research after grad school and climbing the ranks of academia (I assume from the wording that you didn't) you would see that writing papers is far from the worst part... in grad school I often did research to procrastinate writing a paper, now I often write a paper to procrastinate writing a grant request or doing paperwork... :)
- radarsat1 8y agoI think an important thing to take into account is that a very important part of what makes a good scientist is not just how good they are at "doing science", but how good they are at communicating it. A good scientist is a good communicator. Even if that means finding people who you can work with who are good communicators, it's part of the job. Coding up a really clever solution and just kind of hoping people will come across it and appreciate is not really doing science. (Not saying that's what you are doing, I'm just going on a tangent here.) The point is, ever since the enlightenment, a strictly critical part of the job of being a scientist has been the ability to elaborate your ideas to others, and to argue for its merit. So yeah, doing the work is the fun and motivating part, but a big part of the reason that the academic community values well-written scientific papers is because all that work can go to waste if it is not described (and defended!) in a way that is clear and convincing (to the relevant audience of course). Grad students may complain about having to learn to write effective papers, but it's literally just as important as the technical work they are doing --- maybe moreso, since in the future they may very likely change topics, and the writing and communication skills is the part that will carry forward throughout their career.
- l0b0 8y agoI'm reminded of the saying that "Publishing research without data is simply advertising, not science". Not even publishing the research means it doesn't have a chance at advancing the state of the art. I don't understand how such research can be successful at anything other than selling a few extra copies of a software product likely to disappear within a handful of years. Unless it's implemented as the absolute killer feature of a very successful product it's very unlikely anyone will ever know there's anything novel in there.
- jandrewrogers 8y agoThe research does get disseminated, just slowly. The transmission vector is contact with other people with firsthand knowledge of the research. It becomes an oral tradition, which makes it difficult to break into and is inefficient. I've come across many non-publishing research communities in various parts of computer science that continue to develop and share the state-of-the-art amongst themselves. The research isn't being lost, it is just compartmentalized. For example, there is an elegant cache replacement algorithm I learned from a database kernel engineer a decade ago, one of those algorithms that is so obvious in hindsight that you can't believe it never occurred to you. It solves a key problem with the algorithms everyone knows in literature. I've used it ever since and taught a bunch of other database kernel engineers the same algorithm. I have no idea where the person I learned it from got it, but the literature still treats it like an unsolved problem. Many engineers are using it in more and more systems, and there are a few different variants in the wild, but no one has bothered to write it down AFAICT. The salient point is that academia is not the only community that develops and defines the state-of-the-art in computer science, but at least they publish. Without an incentive for non-publishing research communities to publish, it becomes difficult for an outside academic to break into some fields because there isn't an obvious entry point.
- cup-of-tea 8y agoHave you considered finding a partner who has time and is willing to write things up for you?
- westoncb 8y agoI think I'm a good bit earlier in my career, but I've been in a similar situation for a number of years now. It was extremely discouraging to me when I discovered that the typical result of my spending years (in some cases) researching and developing some software/ideas[0] would be far from gratitude and offers of financial assistance or employment to pursue these obviously important subjects ;) Instead the breakdown of responses has been something like 20% dismissals following a cursory reading, and suggestions that what I was doing was some other extremely commonplace thing I was already well aware of and could precisely relate to what I was actually talking about[1]; 30% people saying essentially, "ooh, neat!" and then moving on; 20% inquiries from genuinely interested folks, often times professional researchers (often possible to get the main idea across with them, but still: unless what you're doing relates in a very direct and positive way to their work, that's not going to go anywhere); 30% various, with a surprising amount of hostility mixed into all the categories (except the "ooh, neat!" people). It has certainly helped in the professional realm (for software engineering, not research)—though not in the way I would've hoped. By far the most typical thing is some potential employer sees your work and is like, "oh wow, he must be good to have made this—I can get him to write LOTS of CODE for me!!" but they'll use their knowledge that you value developing original ideas to lure you in, pretending they also care about your ideas, and then allow the memory to slowly fade as your new role doing totally vanilla software engineering solidifies. I actually had someone offer to give me a place to live and pay monthly expenses and tried to arrange for me to move to another state (all the time claiming the world needed the ideas I was working on). I told them about my experience with the above and said that I was maybe paranoid but wasn't getting into something with potential for that again; he replied that it wasn't paranoia but wisdom and we ended our discussion. So now... I realize if you work hard and develop new ideas that may (or may not) end up being important, no one's going to help you unless you turn it into a product or do it in the context of Academia. It's hard work to communicate new ideas, and all too easy to just let them sit rather than doing that hard and often unforgiving work. But I'm still excited about working on the ideas so whatever, for now. ---- [0] To give some context for the kind of ideas/software I'm talking about: I (re-)discovered the idea of a structure editor/projectional editor, not knowing what a grammar or AST even was at the time (I was going to develop a 'linguistic constraint description language' before discovering formal grammars), and built a novel incarnation that may still have lots of potential (almost forgot: it also included a modular system that did something like language-agnostic full-language auto-complete; essentially the inverse of a 'compiler compiler' so I call it a 'generator generator'). That project was largely re-discovery, but led to a formulation for a new general architecture for programming tools built around very simple 'program models' and 'language models' (this is what I'm most interested in pursuing now). I also developed a new kind of general purpose interactive data structure visualization system, which I see as an incarnation of a more general notion of an 'abstractoscope' (something to allow us to usefully/systematically remove detail, rather than adding it like e.g. a microscope). [1] I read recently that Douglas Engelbart had so much trouble with this precise phenomenon (people assuming whatever new idea you're talking about is some common thing from the framework they're used to thinking in), that it inspired him to give a more explicit philosophical grounding/context/framework for his idea, which resulted in a famous piece of writing of his (can't remember the name atm).
- fanf2 8y agoThe academic publication process is a mess, but you don’t have to go down that route: write documentation and blog about it. The scholarship is in how you compare and contrast with other similar solutions, and how you describe where you got ideas from.