4 ms·
Unless efficiency is significantly improved, I don’t see how community incentives (with community resources) could train a model with that many parameters. Woul
by heresjohnny 3y ago
Unless efficiency is significantly improved, I don’t see how community incentives (with community resources) could train a model with that many parameters. Would love it if it happened, though. That would be true Open AI.
- sunnysogra 3y agoAbsolutely!
- verdverm 3y agoWe are seeing both improved efficiencies and smaller models getting better. The pace of improvements is unreal. I would expect in the next few years we will have something on par and open source.