4 ms·

Nice. I'm glad Google is making it easier to find public data sets. I wish that these could be filtered by format, so that you could narrow them to CSV, XML, JS

Nice. I'm glad Google is making it easier to find public data sets. I wish that these could be filtered by format, so that you could narrow them to CSV, XML, JSON, KML, etc. Another nice resource that I've used in the past is 'toddmotto/public-apis' on Github [0]. In the end I would prefer all public data sets to be available over the DAT protocol [1] instead of being hosted only on government or organization websites. A lot of climate data previously made available by the EPA was taken down, and only saved by efforts of volunteers.[2] [0] https://github.com/toddmotto/public-apis https://github.com/toddmotto/public-apis [1] https://datproject.org/ https://datproject.org/ [2] https://www.wired.com/2017/01/rogue-scientists-race-save-climate-data-trump/ https://www.wired.com/2017/01/rogue-scientists-race-save-cli...

neuromantik8086 8y ago
Dat's pretty cool, but it's not the only game out there. The efforts of git-annex/Datalad [0], Academic Torrents [1], Quilt[2], DVC[3], and Pachyderm [4] are also notable in this space. My hopes are broader in the sense that I just hope that dataset versioning happens in the first place. [0] https://www.datalad.org/ https://www.datalad.org/ [1] http://academictorrents.com/ http://academictorrents.com/ [2] https://quiltdata.com/ https://quiltdata.com/ [3] https://dvc.org/ https://dvc.org/ [4] http://www.pachyderm.io/ http://www.pachyderm.io/
- rgardaphe 8y ago
  [5] https://qri.io https://qri.io (we're tackling the dataset versioning problem head on.
sixdimensional 8y ago
Yeah, if they had added an attribute for formats available for each data set, and then added a filter by type to the search (e.g. "type:csv") or similar, it would be great. Sometimes you really want a specific format for a dataset.
- matt4077 8y ago
  Having dabbled a bit in open data, I think "this data is available in too many formats and going through all the options manually is tiresome" counts as a problem you'd love to have.

neuromantik8086 8y ago

Dat's pretty cool, but it's not the only game out there. The efforts of git-annex/Datalad [0], Academic Torrents [1], Quilt[2], DVC[3], and Pachyderm [4] are also notable in this space. My hopes are broader in the sense that I just hope that dataset versioning happens in the first place. [0] https://www.datalad.org/ https://www.datalad.org/ [1] http://academictorrents.com/ http://academictorrents.com/ [2] https://quiltdata.com/ https://quiltdata.com/ [3] https://dvc.org/ https://dvc.org/ [4] http://www.pachyderm.io/ http://www.pachyderm.io/

rgardaphe 8y ago
[5] https://qri.io https://qri.io (we're tackling the dataset versioning problem head on.

sixdimensional 8y ago

Yeah, if they had added an attribute for formats available for each data set, and then added a filter by type to the search (e.g. "type:csv") or similar, it would be great. Sometimes you really want a specific format for a dataset.

matt4077 8y ago
Having dabbled a bit in open data, I think "this data is available in too many formats and going through all the options manually is tiresome" counts as a problem you'd love to have.