3 ms·
Creators of the project here, the first difference is the raw speed if you have many images, video, audio, files etc. We did some benchmarking here: https://gi
by gschoeni 4y ago
Creators of the project here, the first difference is the raw speed if you have many images, video, audio, files etc.
We did some benchmarking here: https://github.com/Oxen-AI/oxen-release/blob/main/Performance.md https://github.com/Oxen-AI/oxen-release/blob/main/Performanc...
~TLDR~
200k+ images from the CelebA dataset take ~6 minutes to add, commit, push into Oxen. Same dataset takes ~3 hours for DVC.
- whatshisface 4y agoHey this is a minor thing but could you re-render that graph to a higher contrast color scheme than light grey on white? :)
- gschoeni 4y agoGood call out, didn't realize how hard to see they were. Updated!
- e12e 4y agoMaybe I missed it - but what is the approximate size of the dataset in GB? Would be interesting to see rclone.org (and maybe s4cmd) (should be faster access to s3?) - and also mercurial and bitkeeper.org - both should behave a little better than git on large files?