3 ms·
Not mentioned here: the usage price for customised models is double the standard engine pricing. Whether you save on prompt tokens is something to consider car
by inopinatus 5y ago
Not mentioned here: the usage price for customised models is double the standard engine pricing. Whether you save on prompt tokens is something to consider carefully.
- stavros 5y agoYou mean half, not double. Davinci is $0.06 per 1k tokens but $0.03 for fine-tuning.
- inopinatus 5y agoNo, I mean what I wrote. The usage price for fine-tuned models is double at $0.12 per 1k tokens. The training price is half, but that’s likely gonna be lost in the noise of any significant bill. Unless you have to retrain often, in which case it’s just more overhead again to consider.
- stavros 5y agoOh damn, I didn't notice that. Yeah, that changes the economics a lot.