4 ms·
Can you clarify the 50x cheaper number? Is this for self-hosting, or if you're hosting on OpenPipe? The pricing on OpenPipe says it's 0.0012 to 0.0016 per 1K t
by derekpankaew 3y ago
Can you clarify the 50x cheaper number? Is this for self-hosting, or if you're hosting on OpenPipe?
The pricing on OpenPipe says it's 0.0012 to 0.0016 per 1K tokens for Llama 7b. GPT-3.5 pricing is 0.0015 to 0.002, so not that different.
I'm assuming the 50x cost reductions are primarily from self-hosting?
- kcorbitt 3y agoYep, the 50x cost reduction is if you self-host a fine-tuned model using the setup demonstrated in in the linked notebooks.