8 ms·
Actually, the real question is why the raw data isn't free. Note: I worked briefly as a contractor at JPL in 2011 on a project related to Curiosity image-proce
by javajosh 13y ago
Actually, the real question is why the raw data isn't free.
Note: I worked briefly as a contractor at JPL in 2011 on a project related to Curiosity image-processing and distribution (among other things).
I argued at the time (fairly strenuously) that the raw data (the data that was used by the scientists in this paper) should be public.
The reason the data is not released immediately to the public is both understandable and frustrating: scientists around the world compete for control of Curiosity's precious mission time. The mission is refreshed every day, each move is voted on and the results uploaded to the rover. The data is not released to give the "winning" scientists first crack at interpreting the data. It's about prestige - if you released the data and get "scooped" by Joe Public it's embarrassing but it's also a lost opportunity for scientific prestige.
The same basic reasoning is why so many JPL-produced datasets (particularly astronomical but also terrestrial - JPL does a lot of weather research) are not public.
Personally, I'd like to see this change. I want all publicly-funded non-military research projects have an open data policy. Clearly this would not apply to research with straight-up defense applications. But Mars rover data? I suspect that scientists will be incentivized without being granted artificial monopolies on that data.
- deleted 13y ago[deleted]
- vowelless 13y agoBut, considering this research is tax-funded (that includes my taxes), shouldn't I, a funder of this research, be allowed to access the raw results?
- seanherron 13y ago(disclaimer - I'm a former NASA contractor and current federal employee, though not at NASA) Yes - and, in fact, the Administration released a memo on this topic earlier this year ("Increasing Access to the Results of Federally Funded Scientific Research" - http://www.whitehouse.gov/sites/default/files/microsites/ostp/ostp_public_access_memo_2013.pdf http://www.whitehouse.gov/sites/default/files/microsites/ost...). However, each agency is responsible for developing their own individual plan on how to carry this out, and I don't believe NASA's has been published yet.
- Helianthus 13y agoThere is a balance between accessing raw results and everyone accessing the means by which those raw results are accessed. I say this as an Information Wants To Be Free t-shirt wearer. No one hates someone who holds something if they know the holding of it is something everyone wants.
- kamjam 13y agoBut why should I, as a non-American, have access to that same data? Or this documents made free in the OP?
- chii 13y agothe fact is, as a non-tax paying non-american you don't have the privilege to access it, but for the "generosity" of the US Gov't (and the fact that enforcing copyright for these things is both costly and not worthwhile).
- rwallace 13y agoSurely the solution to this problem is to put the data into the public domain after a reasonable embargo period of maybe a few months or a year?
- saraid216 13y agoThis seems fair to me, but I'm not the one who's being told, "Look, find a breakthrough in a year or you're going to get scooped by an amateur." It would be ironic and painful if open data policies resulted in scientists leaving the public sector, and I'd really like to see more open data.
- Amadou 13y agoSeems like the guy requesting that certain data be collected is due some measure of academic credit for having the foresight to know what question to ask, even if someone else "scoops" them on the analysis. Sure, sometimes the right question will be starkly obvious, but no system is perfect.
- saraid216 13y ago> Seems like the guy requesting that certain data be collected is due some measure of academic credit for having the foresight to know what question to ask, even if someone else "scoops" them on the analysis. I'd agree, but my knowledge of the academic community is that credit goes by published papers and, secondarily, how often you get cited. This seems like one of those things where we just don't have a great system for giving people credit, and the one we do have is problematic. (Wealth is like that, too. Also, resumes.)
- IanCal 13y agoWhich is where things like figshare [0] work well. You can publish datasets/figures and you get a citable DOI for free. I published code there that my wife cited in her PhD, without having to do the usual computer science thing of writing a paper about it and having people cite that. Disclaimer: I work for a partner company. [0] http://figshare.com/ http://figshare.com/
- mturmon 13y agoI agree with you in general terms (quick release is best). But I think your post is in error because it implies that the raw data is not eventually made public. To my knowledge, this is not true -- especially for Earth missions, I think all that data is public. Perhaps the level 0 data [essentially, raw telemetry] is not, but everything from level 1 up will be public. The data-release culture is very discipline specific. In planetary (e.g. Mars), there are embargo periods -- partly to ensure the systematics are understood. In cosmology, a four-year embargo period for Planck was ended just this summer. This kind of makes sense -- they didn't want half the astrophysicists in the world off chasing a phantom caused by their very sensitive noise-suppression tools. But I understand the community was getting pretty impatient. So, there is push-back. For Earth missions, after an initial calibration period, I think all the data is made public as fast as it can be processed. Indeed, MODIS even broadcasts the raw data to whomever wants to pick it up (http://modis.gsfc.nasa.gov/data/directbrod/ http://modis.gsfc.nasa.gov/data/directbrod/), like disaster responders. Like I said, it's discipline-specific. For disciplines where time matters (Earth, space weather, seismicity/geodesy, time-domain astronomy) there is a real advantage in releasing data fast, and that's what has happened. I could give websites in each case where data is released in near-real time, say, less than 1 hour after taken.
- 46Bit 13y agoI'd love some examples of where to find this data?
- mturmon 13y agoSomeone asked for links, here are a few: geodesy: http://pbo.unavco.org/data/gps/realtime http://pbo.unavco.org/data/gps/realtime Earth: http://rapidfire.sci.gsfc.nasa.gov/realtime/ http://rapidfire.sci.gsfc.nasa.gov/realtime/ space weather: http://www.swpc.noaa.gov/SWN/ http://www.swpc.noaa.gov/SWN/ time-domain astronomy: http://voeventnet.caltech.edu/feeds/Catalina.shtml http://voeventnet.caltech.edu/feeds/Catalina.shtml The last one is pretty neat. It contains an XML event summary that can be used to target a telescope automatically, if you think that event is of interest to you. The events are automatically found by an image-processing front end which taps into a near-earth-objects survey. In other words, they did the hard work already to find unexplained brightness variations.
- exDM69 13y ago> The reason the data is not released immediately to the public is both understandable and frustrating: scientists around the world compete for control of Curiosity's precious mission time. The same applies for the giant telescopes (KECK, VLT, ALMA, etc). A scientist applies for some time doing observations with the telescope, and gets exclusive access to the data for 2 years before the data gets released to the public. But I agree with you too, all scientific data that is acquired with taxpayer money should be released to the public at once.
- marincounty 13y agoI personally feel most government scientific data(non- defense) should be released immediately. I have a feeling there's more than a few Einstein's out there delivering pizzas. Go ahead and laugh, but I feel some big mysteries will be solved by dropouts, and the self taught.
- madaxe 13y agoPrestige? Prestige? Science is not about prestige. It's about science. If you want prestige, go become a jockey, or the world's best hooker. Too many "scientists" are in it for the holidays, money, and "prestige", rather than the, y'know, SCIENCE. I'm afraid it's not "understandable", it's nasty, selfish, and contrary to scientific advancement. By not releasing data, they're preventing the internet hivemind from doing its thing - and it has managed some pretty impressive things (NEAR target spotting, anyone?).
- nolok 13y agoI agree with your message in idea but sadly in the world we live in; without prestige you don't get founding.
- tlarkworthy 13y agowell we don't get paid jack. 99.9 % of the science undertook is boring, inconclusive or negative results. The only carrot is prestige, and the only perks are holidays ... I dunno why you suggested money because there is none (in wages). I expect a big reason for not releasing the data is ... who is gonna do the necessary steps to release the data? You want to take a scientist off his role to build a website and database?? We have little administrative support (probably JPL has better, but still, yet another distraction that eats time from our main job that pays too little). The people that make websites for a living get paid better the scientists, so its a bit harsh to expect scientists to constantly be building website to share data whilst paying them under the industry norms.
- danesparza 13y agoIn his article, the OP mentions "$2.5 billion taxpayer dollars that made it possible". Sorry you don't get paid as much as you'd like -- that doesn't give you the moral high ground. Doing it for "prestige" still isn't a good reason. At a cost of 2.5 billion, I don't think it's too harsh to expect a small budget for releasing the data publicly.
- barry-cotter 13y ago
- Osmium 13y agoI don't think anyone disagrees that the raw data should be eventually made public, and preferably sooner rather than later. But initially it's all about the message: you need time to properly analyse the data and release the results responsibly. If you just released the raw data first, how long do you think it'd be before all manner of crackpot headlines popped up? There'd be a race to be the first publication to get something interesting (and likely wildly incorrect) from the data. The fact is, most people aren't qualified to interpret the data. As for the prestige? That's important too. Not because people care about the prestige in and of itself, but because it enables further scientific research by helping to acquire funding. It's a very principled view to take that scientific research, in theory, should be separate from ego, but in the real world the fact is that reputation matters because not everyone has time to independently verify everything. Ask any practicing scientist and they'll tell you that they're far more willing to trust certain research groups than others, and that's ultimately what the "prestige" is all about.
- chii 13y ago> The fact is, most people aren't qualified to interpret the data. so what if most people isn't qualified? Data is data, and can be used - even for crackpots who wants to use it. If these crackpots publishes something wrong, i m sure they'd be pointed out and either ignored or shunned by the publisher(s) anyway.
- cowsandmilk 13y ago> The fact is, most people aren't qualified to interpret the data. All too often, when that is given as an excuse, the people analyzing the data turn out to have made mistakes and the general public does have qualified individuals who can, and will, point out the errors. Alongside this, frequently this raw data is not shared with the reviewers, who should be qualified and should need the data to do a proper review. Unfortunately, this often results in a rubber stamp culture of reviewing rather than thorough peer review to validate the results.
- driverdan 13y agoAll government data, excluding true national security issues and PI data, should be open and free by default. You shouldn't have to file a FOIA request for anything (in the US), it should be publicly accessible.
- dwc 13y agoI worked on the LRO project for 4 years (on the LROC science operations team, we ran the cameras). LROC released, and continues to release, all of the data to PDS where it is publicly available. A release happens every 3 months, with a six month lag. The data are released as a set, with raw[1] and calibrated data released concurrently. So the raw data actually are available, just not immediately. Now there's some difference between LROC and Curiosity. A Mars rover is much higher profile, of course. But it's also a snail's eye view. I imagine timeliness is a much bigger deal with rover data. Whereas with LROC (and the other LRO instruments) there's a massive data set that can fuel interesting research for years to come. So who comes to get the raw data? Very few people, as it turns out. Who but a planetary scientist getting paid to do Lunar stuff has the time, ability and inclination? Also, DLR (German space people) managed some really awesome original stuff with our data, and not having it as soon as it came down didn't seem to hamper them. Notes: 1. By "raw" I mean EDR (Electronic Data Record), which may be reorganized to facilitate access and conform to PDS format, but contain unaltered, unprocessed measurements.
- scott_s 13y agoA related paper, "The Virtues of Frugality - Why cosmological observers should release their data slowly": http://arxiv.org/abs/0909.2649 http://arxiv.org/abs/0909.2649