3 ms·
What is the best way to do dataset versioning when using Replicate? I get that Replicate saves the dataset version but not the data itself. Is DVC a good fit?
by visarga 6y ago
What is the best way to do dataset versioning when using Replicate? I get that Replicate saves the dataset version but not the data itself. Is DVC a good fit?
Second question - can you tag or attach a comment to a group of experiments?
- fagerhult 6y agoGreat questions! At the moment we recommend passing dataset URIs as params to replicate.init(): https://replicate.ai/docs/guides/training-data https://replicate.ai/docs/guides/training-data, but of course this assumes immutable and stable URIs. DVC would definitely be a good fit, and we have a ticket on our roadmap to integrate Replicate with DVC, Tecton, etc. https://github.com/replicate/replicate/issues/294 https://github.com/replicate/replicate/issues/294 We also have a roadmap ticket for grouping experiments: https://github.com/replicate/replicate/issues/297 https://github.com/replicate/replicate/issues/297, but for now we're recommending params for tags as well. If you have ideas for the design of these features, we really appreciate feedback and comments on these Github issues!