4 ms·
Our goal with Kaggle Datasets is to provide the best place to publish, collaborate on, and consume public data. As a data publisher, you have an easy way to pu
by benhamner 9y ago
Our goal with Kaggle Datasets is to provide the best place to publish, collaborate on, and consume public data.
As a data publisher, you have an easy way to publish data online, see how it's used, and interact with the users of the data. You can create the dataset via a simple web interface, and update it through the interface or an API. We automatically version these updates under the hood.
As a data consumer, you can browse the data online and download it (through the web or an API). You can see the code and insights others have generated on the data through Kaggle Kernels (hosted, versioned IPython notebooks that run in Docker containers). You can fork their code to get started on the data, or start coding from scratch on your own analysis. If you find improvements that could be made to the metadata (dataset/file/column-level descriptions), you can make those directly.
We're rapidly iterating on this product and expanding it's functionality, and would love any feedback and suggestions.
- lgierth 9y agoFirst of all, this looks like a great tool for datasets, thank you. Do you have plans for adding file hashes to the datasets, e.g. sha256? This would make it a lot easier to integrate with other systems.
- benhamner 9y agoThanks and great point! Added this to our list
- amrrs 9y agoSorry for a noob, could you please explain how adding hashes would help in better integration?
- lgierth 9y agoThey mainly help in four ways: - avoid data corruption when downloading/transferring/copying datasets - notice changes/updates in the original dataset - dataset versioning (think how e.g. git turns directories and files into hash trees -- also called content-addressing) - most importantly: stable names without a naming authority
- prepend 9y agoHow does this apply when you can filter / conditional exports? Is the idea that the csv has a fixed hash and if you trust that, you can trust anything else?