4 ms·
Right, so sort of like https://github.com/bigscience-workshop/petals https://github.com/bigscience-workshop/petals but for the training phase. I suppose differe
by barefeg 4y ago
Right, so sort of like https://github.com/bigscience-workshop/petals https://github.com/bigscience-workshop/petals but for the training phase. I suppose different training runs could be proposed via a RFC type of procedure. Then it’s not only the open source model maintainers that put the effort, but also supporters of the project can “donate” their hardware resources.
- lantiga 4y agoSome form of that is very likely the future