3 ms·
It seems strange to me that Google, Amazon, or any other cloud provider hasn't partnered with a non-profit organization to secure grants for a modern, comprehen
by javajosh 14y ago
It seems strange to me that Google, Amazon, or any other cloud provider hasn't partnered with a non-profit organization to secure grants for a modern, comprehensive public data repository. You might call it something like "gov.org". One requirement, of course, is to have an open process for modifying data representation. Crowd-sourced data formats, heh.
(Out of curiosity, why can't we consider the content of .gov websites to constitute this archive and simply a) petition that all public datasets be available on a .gov domain (format to be sorted later) and b) that all future datasets start out life open on .gov.)
- DannyBee 14y agoWe're trying. It's not as easy as you think. The incentives for government to care or want to work with you really aren't there. That said, we've had success in some limited areas. For example, voting information (which was 7+ figure data for the US) is now online. This was originally a partnership I helped create with Pew and Google back in 2008 (now expanded to include MS and others as well, wonderfully): https://votinginfoproject.org/about https://votinginfoproject.org/about After 4+ years, we now have a large number of states voting information online and free. A large number of people at various states also put their asses on the line to help make this happen over the years . I wish I could give them medals. :) There are other example, like patent data, etc. To be honest, i'd rather us stay behind the scenes and just have the info released, even if it means people never know we were involved. It prevents a lot of issues from people who make large amounts of money off data that should be public and open. Of course, there are times/cases where it makes sense to use our name and brand to help, and when necessary, we do that. We also fund plenty of non-profit orgs, including folks like Carl. But getting traction is simply not that easy. A lot of government agencies make revenue from data they publish by selling subscriptions to it or otherwise charging. They don't want to give it to you if your plan is to open it up, even if you are willing to pay large sums. I can't often blame them. Congress cares more about seeing agencies budget neutral than they do about "open data". There were also mandates that public datasets be cataloged sanely and released. This led to data.gov. However, because of the way it worked some agencies had some perverse incentives, like "release the most datasets". This led to humorous things like every single separate piece of data being published as its own dataset on data.gov, which had no good search, making parts of it entirely useless. Anyway, the short answer is: We're trying. We've been trying.
- javajosh 14y agoGood! Thanks for your comment. I thought of an amusing way to think of a rather unamusing situation, so I figured I'd share it. Maybe you'll laugh, I hope. Let's say you have a large extended family and elderly grandparents that have boxes of family photos. You know that the family would love to flip through these, and digitizing them and putting them online is beyond your grandparents' abilities. So you offer to help them digitize and share the files. On your time and dime. But your grandparents surprise you by saying "no". The first thing they're worried about is that, mixed in with those photos, are some risque photos of grandma when she was younger. She doesn't want those shared. But also - and this is the part that really drops your jaw - unknown to you for many years your grandparents have been charging family members a small fee to access the photographs, and it's quite a little side income for them, especially around the holidays when they need it most!
- manglav 14y agoAre there any opportunities for students/fresh grads to help? This seems like a very good cause to spend some time during a gap year or so.
- DrDreams 14y agoAlso, my six-pack of Coors didn't come with instructions for homebrewing and my Windows installation CD didn't come with Linux installation instructions. It's almost as if for-profit entities don't want me to know how to be self-sufficient. What is going on here?