4 ms·
I noticed this too -- I think it's a git LFS issue? The weights themselves are only 330GB, but the .git directory adds another 330GB: $ du -csh pytorch_mod
by moyix 4y ago
I noticed this too -- I think it's a git LFS issue? The weights themselves are only 330GB, but the .git directory adds another 330GB:
$ du -csh pytorch_model*.bin | tail -n 1
329G total
$ du -sh .git
329G .git
Not sure if there's a way to get git-lfs not to do that...
- dekhn 4y agoI haven't used LFS before but it seems to buffer incompletely downloaded files in .git/lfs/incomplete and a copy of "objects" in .git/lfs/objects (I am one of those people who absolutely no interest in how git's DB works, nor how its blob DB works).