4 ms·
It's amazing to see how rapidly things are moving. You can try out CodeLlama-34B on Anyscale Endpoints (an LLM inference API we're building here at Anyscale fo
by robertnishihara 3y ago
It's amazing to see how rapidly things are moving.
You can try out CodeLlama-34B on Anyscale Endpoints (an LLM inference API we're building here at Anyscale for open source LLMs).
https://app.endpoints.anyscale.com/ https://app.endpoints.anyscale.com/
- gsuuon 3y agoThis looks like it might be neat but it has a pretty sparse intro page and then the email signup goes straight into stripe checkout - is there any more info about the service anywhere? Like which models are available, or more pricing info?
- bytefactory 3y agoI had the same question. Being thrown into a payment page right after providing your email is very jarring. I don't want to pay for a product without even giving it a spin.
- robertnishihara 3y agoThanks for the feedback, we'll improve the landing page! The models (and current prices) right now are - Llama-2-7B ($0.25 / million tokens) - Llama-2-13B ($0.50 / million tokens) - Llama-2-70B ($1 / million tokens) - Code Llama ($1 / million tokens)
- gsuuon 3y agoAwesome, thanks! I've been wanting exactly this service.
- 037 3y agoFrom the FAQ: > What rights do you claim to my queries? > During the alpha release, we may use your inputs and outputs to improve the service. In a future release, we may provide the ability to opt out of certain data uses. I understand that you are in alpha, but paying without any privacy guarantees is a little hard to accept right now. Otherwise your service seems really nice, I'm sure a lot of people have been waiting for something like this. Any ETA on the opt-out and further clarification on the matter? Thank you.