5 ms·
The research community really should do a better job of engaging with the wider world, irrespective of whether it increases citations. For example, I had this
by mhandley 6y ago
The research community really should do a better job of engaging with the wider world, irrespective of whether it increases citations. For example, I had this paper in Hotnets 2019, and about 80 people saw my presentation. But I also spent some time, turned it into a little video and put it on YouTube. 360,000 people have seen it there. Now the subtleties were probably lost on many of those people, but if only a few of those people got something out of it, then it will likely have had more impact than the original paper.
https://youtu.be/m05abdGSOxY https://youtu.be/m05abdGSOxY
- Swizec 6y agoThis reminds me of a story from Steven Levitt. He published Freakonomics together with Stephen Dubner then went back into academia while Dubner went down the podcaster route. 15 years later, Dubner has reached millions of people with his work and Levitt recently started a podcast and soft quit academia after realizing that one of his best papers after years of research and hard work got 3 citations. He assumes fewer than 20 people will ever read that work.
- sidr 6y agoI'm not sure why number of views/reads is the metric to optimize for, though. I'm sure more people listen to the Joe Rogan Experience than have read a Mathematical Theory of Communication. Does that intrinsically make it worth more?
- Swizec 6y agoDepends on your goals. Do you want to have impact or chase obscure brain teasers?
- sooheon 6y agoSize of impact is orthogonal to quality of impact, people who chase social stats seem to forget this fact.
- Swizec 6y agoWho said anything about social stats? Levitt in particular says he feels like his research can have a bigger impact if it’s shared broadly with people than if it reaches 10 other academics and that’s it. We’re not talking about likes on social media, we’re talking about breadth of audience for academic research and how scientists can do better than chasing meaningless citation stats. Levitt talks about his thought process in this wonderful episode of Freakonomics. https://freakonomics.com/podcast/math-curriculum/ https://freakonomics.com/podcast/math-curriculum/
- sooheon 6y ago> Who said anything about social stats? You did. > Dubner went went down the podcaster route. 15 years later, Dubner has reached millions of people [...] I assume this is measured in terms of subscribers or listen counts. I'm not saying the Freakonomics Stevens have/haven't had quality contributions to the world, I'm not even saying anything w.r.t. average podcast quality vs. average academic paper quality. I'm only saying that people often measure impact along only one dimension.
- deleted 6y ago[deleted]
- kaitai 6y agoI gotta say A Mathematical Theory of Communication is not an obscure brain teaser, and has had quite an impact.... so your reply doesn't really reflect what the previous poster was asking about...
- mathattack 6y agoLevitt is leaving academia? Wow - that’s news!
- Swizec 6y agoMight be more of a sabbatical. This is the Freakonomics episode where he talked about this https://freakonomics.com/podcast/math-curriculum/ https://freakonomics.com/podcast/math-curriculum/
- mathattack 6y agoInteresting. I will listen. He’s a distinguished service professor which is as high as you can get.
- mathattack 6y agoThis sounds like an empirical side project rather than leaving academia, no? Has it been long enough to see the results? Interesting that they put their hopes on data fluency on the College Board while the SATs are falling out of fashion.
- m0zg 6y agoSame with MOOCs I think. It's too bad most of them are so bad they are not worth taking, but the ones that are good (e.g. Andrew Ng's machine learning MOOC) are having insane impact even though most people don't finish them.
- jessriedel 6y agoMost research is not useful or suitable to the wider world.
- Pfhreak 6y agoI guarantee a cottage industry of YouTubers would pop up digesting and rewrapping that content. Today, it's probably too inaccessible for them to do so.
- catalogia 6y agoI sincerely doubt it. There is much more that is published than the general public has an appetite for. Even in a narrow scope, people have a limited appetite for any particular form of content before they're satiated. If too much content is produced for any particular topic, people will burn out and tune out.
- cameronbrown 6y agoTwo Minute Papers is a great example of this: https://www.youtube.com/channel/UCbfYPyITQ-7l4upoX8nvctg https://www.youtube.com/channel/UCbfYPyITQ-7l4upoX8nvctg
- matthewfcarlson 6y agoTwo minute papers is fantastic! I just wish that all of the papers he covers had source code available. A few of them I've gotten excited about and hopped around the net to read the paper only to find no code available.
- tetris11 6y agoThis is the state of science in a lot fields unfortunately. Many reviewers skim the paper, put in a thinly veiled complaint about why their own paper was not cited, and don't bother with the code. The code itself is always usually a mess: no readme, no license, random binaries, and a 'pipeline' which is simply a bunch of perl and python scripts cobbler together from snippets found on the web. People publish, then move onto the next project. There is no maintenance.
- yutopia 6y agoI think the general trend of researchers becoming more media-savvy is great. But I also get the sense that researchers are increasingly choosing to work on Twitter-friendly topics (e.g., sensational, visually striking, reducible to sound bites) — whether that’s also positive I’m not so sure.
- n4r9 6y agoI wonder if there's an inverse relationship between the level of pressure on scientists to publish, tweet, blog and demonstrate the social relevance of their work, and groundbreaking advances in fundamental physics.
- raxxorrax 6y agoI don't think so. The culture of publish or perish is certainly detestable and I don't think 160 characters are enough for a synopsis. But I don't think it negatively affects research. At least I hope so. Fundamental research and humanities both have these funding issues. It may be worth a discussion if these fields could benefit from increased public funding, because some forms of research don't result in an immediate economic benefit.
- n4r9 6y agoI'd be really surprised if it didn't have at least some negative impact, not so much because of the amount of funding but because of what you have to do these days to get the funding. The more time and energy you force academics to spend on journal/conference submissions, grant proposals, impact assessments, and public outreach, the less they have to spend on research. I'd expect it to be especially true for more abstract subjects as they're harder to distill into a concise form or to describe the social impact of, and often require protracted periods of intense study/thought which admin responsibilities distract from. Add to that the number of distractions that everyone is subjected to in the modern world, and I start to feel like it's no wonder we're still struggling with quantum interpretations or going beyond the standard model. Now, I'm not saying that we should reduce the number of conferences or papers, or amount of outreach. Just the amount of time academics need to spend on them. Of course there will always be a few of the elite who will find time to sit and think for hours per day outside of these, nevertheless the harder you make it the more knowledge will suffer.
- alextheparrot 6y agoThat video is brilliant, by the way. I just watched it all the way through — it makes sense that a video that had such a high learning bandwidth (For lack of a better term) gets so many views.
- mhandley 6y agoWhat's interesting is that I didn't make that video for a general audience. I made it for the networking research community, so I didn't bother to explain what Dijkstra's algorithm is, or any of the basics really. There are also a number of graphs which conventional wisdom says should not be in a video for a general audience. Turns out we often underestimate the large niche technical-but-not-specialist audience which doesn't mind things not being dumbed down too much.
- the_omegist 6y agoThat's a noble practice but I think everyone should stick at what he does best, for a better overall efficiency. As long as you make your paper easily available, as another commenter said, another person can make it more comprehensible for the general public. One of the causes of the slowdown (even if marginal) of science and research in general is the administrative and social media overlays that were added to them.
- conjectures 6y ago> As long as you make your paper easily available, as another commenter said, another person can make it more comprehensible for the general public. I'm not sure you appreciate how hard this might be for someone who is not closely connected to a project. The people who can do that reliably will have: a) the academic chops on a similar level of a peer reviewer b) social media skills. a) puts them back in the bracket of people you don't want to 'slow down'.
- the_omegist 6y agoWell I agree but I see it like a pyramid. You don't have to worry about people at the bottom of the knowledge pyramid getting access to the last breakthrough in some field if they don't already know the basics about that field. They will naturally access it when they "climb" this pyramid of knowledge through more specialized sources or studies. More over : the population of people who are good at doing something isn't necessarily the same as the one good at explaining it. It's like saying Newton would have to spend 20% of his time explaining to 14yrs old kids what he's doing when someone less capable than him would do it as good but would leave Newton free for what he does best.
- mhandley 6y agoA typical computer systems research project takes two years, though many take a lot more. After several years research, we write a paper like it's 1920, spend a day knocking together some powerpoint slides, and give a 20-minute presentation at some conference (and those are the successful projects). Science, whether pure or applied, is about pushing forward the bounds of knowledge and then, crucially, communicating those insights. There are so many papers published these days - one of my papers has been cited over 10,000 times - that's an average of 1.5 times a day for 19 years straight. Seems unlikely most of those papers ever get read. If you still believe in the work once it's published, you really should do your best to communicate your excitement to others. Unless you made a huge breakthough (unlikely in any field), no-one else is going to learn from your insights otherwise.
- ad404b8a372f2b9 6y agoIt's a matter of incentives, having made such a video you no doubt have a good understanding of the time required to produce this kind of content. Even publishing clean, reproducible code, which should be the absolute minimum, takes a lot of time and is absolutely not rewarded. So when researchers have a choice between publishing two papers with no supplementary material or publishing a single one that is well documented, cleanly coded, with a blog post, a video explanation, etc... it's no question. With the current incentive structures the choice is made for you.