3 ms·

Fine tuning for GPT came out a whole month ago. Before that, the choice was mostly between prompt engineering with GPT or fine-tuning dramatically inferior "ope

• jasongill 3y ago
  ... Fine tuning for OpenAI's GPT LLM's has been available for years now, at least since the GPT-3 private beta if not earlier (and obviously you could train the open models yourself)
  • medbrane 3y ago
    But not for gpt3.5 family.
  • goodside 3y ago
    That's true, but it was expensive and until recently you could only tune older versions of GPT-3 lacking both instruction tuning and the code pre-training of the Codex models (from which GPT-3.5 is thought to descend). You had to want tuning so badly you were willing to 6x the token cost and go back in time 2 years.