3 ms·
I don't believe the weights for GPT-3 are public and it would be expensive to fine tune such a large model.
by ALittleLight 4y ago
I don't believe the weights for GPT-3 are public and it would be expensive to fine tune such a large model.
- dwohnitmok 4y agoOpenAI provides an API for fine-tuning. https://beta.openai.com/docs/guides/fine-tuning https://beta.openai.com/docs/guides/fine-tuning
- speedgoose 4y agoI paid a bit more than $1 to fine tune the biggest GPT3 model for my use case. I didn’t push a lot of data and the fine tuning took 35 minutes (without counting the time waiting in the queue).
- Der_Einzige 4y agoIt's not that expensive to find tune huge models. You can find tune gpt-J or gpt-neo with a 3090