3 ms·
Does anyone know how they can run it so cheaply? Fine-tuning is fairly cheap for ChatGPT. But if it’s truly a fine-tuned model, then they have to run a copy of
by sinuhe69 3y ago
Does anyone know how they can run it so cheaply? Fine-tuning is fairly cheap for ChatGPT. But if it’s truly a fine-tuned model, then they have to run a copy of the customer’s model, isn’t it? How can they provision it so quickly? Or did they know how to do sort of delta with the last layers?
- freedomben 3y agoIt's not a different model, it's just a customized system prompt. It costs basically nothing extra for them to run. Actual fine-tuning is $$$
- spdustin 3y agoTechnically, it is (it’s gpt-4-gizmo). There’s a chance that had some fine-tuning for understanding the presence of the just-in-time function calls for actions. (Names for Actions in Custom GPTs are tagged with “jit”)
- agodfrey 3y agoIt isn’t a finetuned model. Not sure what exactly it is, but it seems like just a bunch of prompt engineering.
- minimaxir 3y agoThere is likely zero finetuning: everything GPTs can do can also be done with clever system prompt engineering. GPTs likely use extra prompt engineering to align everything.
- siva7 3y agoIt has nothing to do with fine-tuning - like most of these startups using the openai api. It's basically all clever prompt engineering techniques that emerged over the last years finally combined into ChatGPT.