4 ms·
I'd love a tool where I can upload a private dataset and RLHF a model (even better if the tool provides the pre-trained model) without me having to worry about
by scottydog51834 4y ago
I'd love a tool where I can upload a private dataset and RLHF a model (even better if the tool provides the pre-trained model) without me having to worry about GPUs, memory, commercial access, or even writing any python code. I'd happy pay several hundred and maybe several thousands for access to this.
- Tepix 4y agoEven better would be a crowdfunding platform where you can collect some money from a bunch of people and then use it to fine-tune the bigger models (30B and 65B in the case of LLaMA).
- chankstein38 4y agoOpenAI allows you to fine tune any of their LLM models. I'm not sure if your requirements were "without paying OpenAI something" but if you are ok with that, fine tuning with them is pretty straightforward. IANAL or anything but if I recall they even promise they won't use your data for their training.
- sebzim4500 4y agoThey let you do this with their GPT-3 derived models, but not the GPT-3.5 or GPT-4 ones. That would be unsafe lol
- ttul 4y agoI think that tool would have broad appeal, but I wonder if the most likely case is that it would be buried inside other, higher-level systems, such as customer support automation SaaS.