2 ms·
This isn’t folding@home. These models need as near to synchronous parameter updates as possible. You need a real facility to do this.
by jeffbee 4y ago
This isn’t folding@home. These models need as near to synchronous parameter updates as possible. You need a real facility to do this.
- sebzim4500 4y agoYeah but we could definitely crowdsource enough money to make an extremely effective finetuned version of LLaMA. The challenge there is probably more about finding and cleaning data.