Finetuning has been more or less obsolete for LLMs since the introduction of GPT-3. This was a major discovery of the original paper. Codex-Davinci only existed

Finetuning has been more or less obsolete for LLMs since the introduction of GPT-3. This was a major discovery of the original paper. Codex-Davinci only existed because the original gpt wasn't trained on much code not because a version trained on sufficient code would need special code optimizations/fine-tuning. and yes, LLMs are general intelligences. there is nothing narrow about them at all