3 ms·
Are there any benchmarks/results showcasing the performance increase with fine tuning? Like showcasing a list of prompt and answers between a fine-tuned LLM and
by chenxi9649 3y ago
Are there any benchmarks/results showcasing the performance increase with fine tuning? Like showcasing a list of prompt and answers between a fine-tuned LLM and a non fine-tuned one. Could be with LLAMA 2 as well.
Even if it's quite specialized like in Medical/Legal, it would be great to see the expected value one can derive from fine-tuning.
- icelancer 3y agoThere is such a limited amount of this and most of what you can find is blogspam. Lots of people asked the OpenAI GPT rep on Twitter for exactly this; hoping we see it as GPT-4 becomes tunable.
- swyx 3y agolink for those who also wanted to look it up https://twitter.com/OfficialLoganK/status/1694062949177139610 https://twitter.com/OfficialLoganK/status/169406294917713961...
- icelancer 3y agoThat's a different link than the one I was thinking of, but I came here to post it all the same! Definitely encourage everyone to post in support of increased documentation and specific examples on why you'd use it.