4 ms·
I'm still looking forward to a fine-tuning vendor publishing an interactive real-world example of one of their fine-tuned models, accompanied by the exact train
by simonw 2y ago
I'm still looking forward to a fine-tuning vendor publishing an interactive real-world example of one of their fine-tuned models, accompanied by the exact training data that was used to create it.
OpenAI's examples here are artificial, and there's no mechanism to try out the results: https://platform.openai.com/docs/guides/fine-tuning/fine-tuning-examples https://platform.openai.com/docs/guides/fine-tuning/fine-tun...
Fine-tuning is expensive in terms of both time and money (more so time these days, a lot of the vendors have free trials now). Before I put that work in I want to get a much better idea of the kind of results I can expect.
- bob1029 2y agoFine tuning always felt like something that only works at incredible scale with a lot of data. Prompt engineering, RAG, etc. provide so much more uplift per unit time invested. Maybe fine tuning makes sense if you have a 9 figure budget and thousands of humans to throw at it. I don't feel this works in a typical startup ecosystem. I couldn't move the needle with the amount of data I had on hand.
- btown 2y agoTo this point, guaranteeing that your fine-tuning doesn't actually weaken the hallucination-resistance of state-of-the-art base models, by overfitting to specific examples in your training set, is a really hard thing to measure. Unless you have robust ways of validating LLM output so that you can do real cross-validation, few-shot prompts, where you can instruct the LLM exactly how much you want it to generalize from those examples, may be far better at achieving many goals.
- qudat 2y agoWhat about techniques like LoRA?
- bob1029 2y agoI thought these models were already leveraging this technique (or something approximating it) as part of their fine tuning offering.
- boredemployee 2y agoperhaps my ignorance and my beginner level on the topic are biasing me, but in my experience, fine-tuning the GPT-3.5 turbo has elevated our operation to another level. When we put it into production, it became much faster, more accurate, and cheaper when compared to original gpt4. Our use case is to make unstructured data return a JSON with some key-value entities where the order matters.