2 ms·
GitHub have a soft repository size limit of 5GB, documented here: https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-large-fi
by simonw 3y ago
GitHub have a soft repository size limit of 5GB, documented here: https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-large-files-on-github#repository-size-limits https://docs.github.com/en/repositories/working-with-files/m...
Soft size limit means "If your repository excessively impacts our infrastructure, you might receive an email from GitHub Support asking you to take corrective action." - I know people who have received such emails.
Most model releases happen through Hugging Face which does not have such a size limit.
- KomoD 3y agoThey'd probably just charge you for it. They sell "data packs" for LFS. https://docs.github.com/billing/managing-billing-for-git-large-file-storage/about-billing-for-git-large-file-storage https://docs.github.com/billing/managing-billing-for-git-lar...
- zepton 3y agoIt would be super expensive to use LFS to distribute this: > Each pack costs $5 per month, and provides 50 GiB of bandwidth and 50 GiB for storage So they would need to pay for 6 data packs (or $30) for every 300gb download. (https://docs.github.com/en/billing/managing-billing-for-git-large-file-storage/upgrading-git-large-file-storage https://docs.github.com/en/billing/managing-billing-for-git-...)
- rezonant 3y agoI'd bet Hugging Face would be happy to have hosted these canonically too, so not sure why that doesn't happen more.
- osanseviero 3y agoThe model is also at https://huggingface.co/xai-org https://huggingface.co/xai-org