3 ms·
Buy a 10tb disk on Amazon for ~$300, start backing up every git repo in existence
by smoldesu 4y ago
Buy a 10tb disk on Amazon for ~$300, start backing up every git repo in existence
- jasonladuke0311 4y agoEven with a shallow clone, I'm curious what percentage of repos this would hold.
- smoldesu 4y agoThe Stack is ~3tb: https://huggingface.co/datasets/bigcode/the-stack https://huggingface.co/datasets/bigcode/the-stack If you had 10tb worth of decently written code, you could probably train a competitive model.