3 ms·
If you want to query the Llama-2 models, you can use Anyscale Endpoints [1]. Note: I work on this :) Llama-2-70B is $1 / million tokens, which is the most cost
by robertnishihara 3y ago
If you want to query the Llama-2 models, you can use Anyscale Endpoints [1]. Note: I work on this :)
Llama-2-70B is $1 / million tokens, which is the most cost-efficient on the market that I'm aware of.
[1] https://app.endpoints.anyscale.com/ https://app.endpoints.anyscale.com/
- TeMPOraL 3y agoTried to plug it in to my favorite chat frontend (TypingMind), bounced off CORS. Is this something you can do something about?
- andrewmunn 3y agoHow do you keep the cost down?
- zo1 3y agoCan we supply our own fine-tuned models? Edit. I'm sure it's answered on your site but sometimes it's better to include it right here! :)