3 ms·
Xvc: A CLI tool to manage data and ML pipelines in Rust (GPL3)
- emresahin 2y agoXvc is an alternative to Git-LFS, git-annex (in data management) and DVC (in data and pipelines management.) - Track binary/unstructured data and artifacts along with the code - Run pipelines composed of steps depending on files, globs, URLs, SQLite queries, regexes, hyperparameter files etc. (in parallel) - Store binary data files with local, rsync and S3 compatible storages, separately from Git repository - Automates git commands to commit tracked metadata files but can also work without git