3 ms·
Use GPT-NeoX-20B instead for 100x cheaper cost via https://nlpcloud.com/ https://nlpcloud.com/ or another provider. It's $0.00004 per token. They even let you f
by MacsHeadroom 4y ago
Use GPT-NeoX-20B instead for 100x cheaper cost via https://nlpcloud.com/ https://nlpcloud.com/ or another provider. It's $0.00004 per token. They even let you fine tune your models and then charge $0.00007 per token for using a fine tuned model.
Basically anything is cheaper than using OpenAI, since their models are extremely inefficient. The latest Meta LLaMA-13B outperforms GPT-3 175B on a single 24GB video card. LLaMA-7B outperforms all other open source models and runs on a single 10GB video card. https://rentry.org/llama-tard https://rentry.org/llama-tard
For more options check out the Chatbot General thread on /g/ https://boards.4channel.org/g/thread/91897528 https://boards.4channel.org/g/thread/91897528