4 ms·
This makes me think of http://www.pachyderm.io/ http://www.pachyderm.io/. Although Quilt seems to be more like github for data, whereas Pachyderm is more like g
by gouggoug 9y ago
This makes me think of http://www.pachyderm.io/ http://www.pachyderm.io/. Although Quilt seems to be more like github for data, whereas Pachyderm is more like git for data.
- lobster_johnson 9y agoPachyderm was the first thing I thought of. In fact there should be opportunities for collaboration here. Pachyderm looks brilliant for high-scalability parallel data processing, and the versioned data part is a way to not just maintain the history of the data, but also avoid reprocessing of data that hasn't changed since the previous run.
- jaz46 9y agoHi, I'm one of the creators of Pachyderm. We've been talking with the Quilt founders about various ways to work together and think there are some really exciting opportunities!
- akarve 9y agoWe really like pachyderm and know the founders. Quilt is zero-config focused on storage and versioning, pachyderm is more focused on on-prem and compute (as a Hadoop replacement).