4 ms·
Of course, but even still the level of scale, clean data, and human supervision needed may be significant. It's reported OpenAI used an army of humans to genera
by stevenhuang 4y ago
Of course, but even still the level of scale, clean data, and human supervision needed may be significant. It's reported OpenAI used an army of humans to generate question answer prompts and rate the model output.
They kept the details closely guarded and only hinted at how they did RLHF and transitioned the architecture to self supervised learning.
- pps 4y agoI'm stupid in this area and have only a very broad understanding of "AI". But isn't this already happening in this project? https://github.com/LAION-AI/Open-Assistant https://github.com/LAION-AI/Open-Assistant