2 ms·
Something interesting is that there is no mention of fine-tuning. Is GPT-4 so good at general tasks out of the box that fine-tuning is obsolete? Can one model r
by dougmwne 4y ago
Something interesting is that there is no mention of fine-tuning. Is GPT-4 so good at general tasks out of the box that fine-tuning is obsolete? Can one model really be equally good at Python and poetry?
- famouswaffles 4y agoFinetuning has been more or less obsolete for LLMs since the introduction of GPT-3. This was a major discovery of the original paper. Codex-Davinci only existed because the original gpt wasn't trained on much code not because a version trained on sufficient code would need special code optimizations/fine-tuning. and yes, LLMs are general intelligences. there is nothing narrow about them at all
- flangola7 4y ago>Is GPT-4 so good at general tasks out of the box that fine-tuning is obsolete? Can one model really be equally good at Python and poetry? This is correct. It is able to generalize across domains intelligently. Given the results of fine tuning in earlier models, fine tuning GPT-4 for a specific purpose will probably produce super-human ability.