13 ms·
I think the main asset of fine tuned models are their training datasets. If you fine tune an OpenAI model, you can fine tune another model with little efforts.
by speedgoose 3y ago
I think the main asset of fine tuned models are their training datasets.
If you fine tune an OpenAI model, you can fine tune another model with little efforts. Just use the model you prefer. Today it might be something from OpenAI, but it could also be a small mistral. It’s worth doing a few benchmarks.
- authorfly 3y agoI agree that the dataset will absolutely make it. But for the use case I'm looking at, the LLM has to be available for batch concurrent inference to be useful. Perhaps unlike most research on datasets, time-to-inference-completion is important. But at the same time I appreciate your answer in the context of how you could be burned anyway by OpenAI say revoking access, and that you are saying the dataset allows model/freedom from the platform of OpenAI as such.