3 ms·
> Have you tried fine tuning GPT3 via the OpenAI APIs for this I haven't. That's not a bad idea. > it would at least help demonstrate it it's possible to get
by baobabKoodaa 4y ago
> Have you tried fine tuning GPT3 via the OpenAI APIs for this
I haven't. That's not a bad idea.
> it would at least help demonstrate it it's possible to get the results you want with the current best-in-class language model before you try to run that against a smaller model that you can fit on your own hardware
The dataset you saw was (mostly) generated with ChatGPT and davinci-002, by using prompt engineering instead of fine tuning. So it's definitely possible to produce good results like this (though no judgment here on the question of prompt engineering vs fine tuning).