2 ms·
In the age of Large Language Models, large blobs will become the rule, not the exception. You’re not going to retrain models costing $100M to build from scratch
by fmajid 3y ago
In the age of Large Language Models, large blobs will become the rule, not the exception. You’re not going to retrain models costing $100M to build from scratch because of the limitations of your SCM.
- prepend 3y agoI don’t store those in my scm. It’s not a limitation of my scm that I can’t store a 20gig model directly in the repo. So you’re right, I’m not going to retrain models costing $100M because of SCM limitations. That’s because I don’t have any SCM limitations.