3 ms·
Serious question - why doesn’t someone crowd source the funds to train a GPT scale model for open source? I assume it’s not just a matter of a ton of GPU insta
by fnordpiglet 3y ago
Serious question - why doesn’t someone crowd source the funds to train a GPT scale model for open source? I assume it’s not just a matter of a ton of GPU instances?
- djbusby 3y agoDoesn't one need to have a bunch of "very good" data to train on? I'm under the impression that sourcing costs are large.
- throwoutway 3y agoYes, and the labor of the Reinforcement Learning from Human Feedback (RLHF) .. is anyone crowdsourcing this?
- jahewson 3y agoAnthropic and Databricks have made datasets available. OpenAssistant is crowdsourcing one.
- fnordpiglet 3y agoThese seem like things affordable with money and crowd sourcing of volunteer labor. In some ways it feels too valuable to leave in the hands of megacorps.