3 ms·
As someone who tried to use git to do this for large sets of data, I'm very glad this exists. Will be trying this out in the future.
by mfDjB 6y ago
As someone who tried to use git to do this for large sets of data, I'm very glad this exists. Will be trying this out in the future.
- kevlar1818 6y agoYou may also be interested in a simple tool I'm building that works in concert with source control to store, version, and reproduce large data: https://github.com/kevin-hanselman/dud https://github.com/kevin-hanselman/dud My project is in its infancy (open-sourced less than a month ago), but I'm pleased with its UX thus far. There's lots to add in terms of documentation, but Dud currently uses Rclone[1] for remote syncing. [1]: https://rclone.org/ https://rclone.org/
- konda 6y agoI'd checkout dolthub.com! Dolt is built for git workflows (branches and merges) on top of large datasets.
- timsehn 6y agoThanks for the shout out here. CEO of DoltHub speaking :-)
- deleted 6y ago[deleted]