4 ms·
Could you possibly reduce those costs by fine-tuning the model with the assignment text and reference code, rather than including them in the prompt?
by Paul-Craft 3y ago
Could you possibly reduce those costs by fine-tuning the model with the assignment text and reference code, rather than including them in the prompt?
- vanviegen 3y agoOpenAI only offers finetuning for the pre-chatgpt models, so I doubt we'd get good enough results from that. Something like this might work with a self-hosted (llama) model though. We do have a (small) database of student work and teacher feedback for each assignment we could use for training (privacy permitting).