3 ms·
Is there pricing available on any of these vendors? Open source models are very exciting for self hosting, but the per-token hosted inference pricing hasn't be
by AaronFriel 2y ago
Is there pricing available on any of these vendors?
Open source models are very exciting for self hosting, but the per-token hosted inference pricing hasn't been competitive with OpenAI and Anthropic, at least for a given tier of quality. (E.g.: Llama 3 70B costing between $1 and $10 per million tokens on various platforms, but Claude Sonnet 3.5 is $3 per million.)
- handzhiev 2y agoLlama 3 is 0.59/0.79 on Groq. Still no price for 3.1