3 ms·
GPT-4 is the best coding model by far and you can’t fine tune it yet. Start with GPT-4 and RAG. Fine tune is good for changing behavior. For example you could
by menzoic 2y ago
GPT-4 is the best coding model by far and you can’t fine tune it yet. Start with GPT-4 and RAG.
Fine tune is good for changing behavior. For example you could create a dataset that makes the model directly output fully formed projects. Using RAG alone would require a bunch of prompt engineering to get the same.
- dchuk 2y agoSo if I’m understanding you correctly, it may make sense to fine tune a model specifically on good rails open source project examples?
- ericlewis 2y agoGPT-4 is fine-tunable. https://platform.openai.com/docs/guides/fine-tuning https://platform.openai.com/docs/guides/fine-tuning “ Fine-tuning for GPT-4 is in an experimental access program - eligible users can request access in the fine-tuning UI when creating a new fine-tuning job.” You need only have fine-tuned a 3.5 model ime.