3 ms·
It shouldn't be 100x. We've built an LLM API at Anyscale, and the price comparison works out as follows (per million tokens) - Llama-2-70B: $1 (on Anyscale End
by robertnishihara 3y ago
It shouldn't be 100x. We've built an LLM API at Anyscale, and the price comparison works out as follows (per million tokens)
- Llama-2-70B: $1 (on Anyscale Endpoints [1])
- GPT-3.5-turbo: $1.50 - $2 (OpenAI [2])
[1] https://app.endpoints.anyscale.com/ https://app.endpoints.anyscale.com/
[2] https://openai.com/pricing https://openai.com/pricing