4 ms·
OpenAssistant has already collected 100,000 human feedback examples, estimated 5,000+ hours of human work via crowd sourced volunteers. Enough programmers want
by Taek 4y ago
OpenAssistant has already collected 100,000 human feedback examples, estimated 5,000+ hours of human work via crowd sourced volunteers.
Enough programmers want this badly enough that its going to happen. Inference at 8 GB and fine tuning at 24 GB, just like stable diffusion, on a 13B model.
- boredhedgehog 4y agoFrom what I gather, tuning a language model is like jury duty: The more eager someone is to volunteer, the less useful his input is going to be.
- Taek 4y agoI don't think the quality of the OpenAssistant data represents that idea at all.
- sebzim4500 4y agoThis sounds incredibly hard to believe, unless your concern is that advertisers will poison the well.
- vintermann 4y agoIs it that hard to believe? If you look at Stable Diffusion, I'd say a lot, maybe the majority of the volunteer effort was focused on anime girls and "realistic" pictures of anime girls (which amounts to young faces on adult bodies).