2 ms·
The public GPT-4 is a fine-tuned model that exhibits mode collapse and has a certain writing style induced by the fine-tuning [1]. This "overly helpful assistan
by cubefox 3y ago
The public GPT-4 is a fine-tuned model that exhibits mode collapse and has a certain writing style induced by the fine-tuning [1]. This "overly helpful assistant" style can't be fully eliminated with custom system prompts. The GPT-4 base model, were it available, could likely be prompted to act much more like a normal human.
1. This can be seen by comparing the fiction writing ability of the GPT-3.5 base model with the fine-tuned ChatGPT-3.5 model: https://nostalgebraist.tumblr.com/post/706441900479152128/novel-writing-chatgpt-vs-code-davinci-002 https://nostalgebraist.tumblr.com/post/706441900479152128/no...
- famouswaffles 3y ago100%. The GPT models are trained not to pass the Turing test. and yes, fiction writing suffers for it. What i would give to have access to base GPT-4 for fiction writing
- quietpain 3y agoThe world of publishing is certainly seeing the attempts for such an llm: https://www.npr.org/2023/02/24/1159286436/ai-chatbot-chatgpt-magazine-clarkesworld-artificial-intelligence https://www.npr.org/2023/02/24/1159286436/ai-chatbot-chatgpt... And I do wonder how difficult it is now. We have datasets like libgen and Anna’s Archive … are there public llm’s out there that have been trained in this way?
- cubefox 3y agoProbably the next best thing: I think Microsoft Azure still offers access to the GPT-3.5 base model (aka code-davinci-002). But OpenAI removed it from the API. Too powerful perhaps.
- dacryn 3y ago> Too powerful perhaps no, that's pure marketing. They have difficulty scaling it in a cost effective way. simple as that. Everything else is just sales talk
- cubefox 3y agoWhen the removed the base model, they didn't remove text-davinci-003, which essentially is the same GPT-3.5 model, just with fine-tuning. So your explanation doesn't fit.