3 ms·
I've been thinking we need a OSS source for fine-tuning and RLHF data. Like an npm, cargo, pip or whatever for RLHF data for any topic. From the original Verge
by zoogeny 3y ago
I've been thinking we need a OSS source for fine-tuning and RLHF data. Like an npm, cargo, pip or whatever for RLHF data for any topic. From the original Verge article:
> Only the companies that can afford to buy this data can compete, and those that get it are highly motivated to keep it secret.
In the same way that you want the source code of your software to be accessible to you to edit, it seems reasonable to want your AI to be accessible to you. In a world where models are open, that means having the data to train them that is open.
- RicoElectrico 3y agoHuggingFace is exactly that. Apart from models, you can find quite a lot of fine-tuning datasets for transformer models.
- zoogeny 3y agoHugging face may act as a repo as I described, but I'm thinking about the platform infrastructure around it. Companies like Scale and Surge have platforms that allow 100,000+ individuals to annotate responses from LLMs. Right now, those annotations are going into walled gardens. As an analogy, I'm thinking something more like Wikipedia. It isn't just a dataset. It is a browser, editor, etc. that is layered on top of the data. Wikipedia isn't just the data stored in giant flat files.