5 ms·
No git would be impossible. I’ve never seen a repo even a few GB in size, if you are uploading non code files you really should not be using git. Git is a versi
by sashank_1509 3y ago
No git would be impossible. I’ve never seen a repo even a few GB in size, if you are uploading non code files you really should not be using git. Git is a version management software for code. I often see repos which images and even videos checked in, please don’t, there are so many far better and more performant solutions out there.
The other approach would be to use AWS S3 or other cloud providers which would cost them money every time someone downloads their code, which is not their prerogative to pay for when they are releasing something for free. Torrents seems like the only good solution, unless someone hosts this on the cloud for free for everyone.
- djhn 3y agoScott Chacon (github cofounder) mentioned in a recent talk that the Windows repo is 300GB https://youtu.be/aolI_Rz0ZqY?si=MOo2eS6dsKKAxmsP https://youtu.be/aolI_Rz0ZqY?si=MOo2eS6dsKKAxmsP
- sashank_1509 3y agoInteresting, had no idea git had a VFS or that MS was a Monorepo. I guess git is much more capable than I thought but the average user really should just be uploading code into github
- sroussey 3y agoHuggingface will disagree with impossible as their models are available via git, sometimes broken up in pth files. Still, as far as sentiment goes, yeah git for model weights is an impedance mismatch for sure!
- rezonant 3y ago> No git would be impossible. I’ve never seen a repo even a few GB in size, if you are uploading non code files you really should not be using git It's not actually a limitation in git itself, especially if you use Git LFS. People use Git for Unreal projects and big ones can be half a terabyte or more in size.