3 ms·
This reads like something that a site using AdSense would use. 2.5 is interesting > Your information, including Personal Data, is processed at the Company's o
by skilled 3y ago
This reads like something that a site using AdSense would use.
2.5 is interesting
> Your information, including Personal Data, is processed at the Company's operating offices and in any other places where the parties involved in the processing are located. It means that this information may be transferred to — and maintained on — computers located outside of Your state, province, country or other governmental jurisdiction where the data protection laws may differ from those in Your jurisdiction
> Your consent to this Privacy Policy followed by Your submission of such information represents Your agreement to that transfer.
And the table in the middle of the policy...
> Category Collected? Disclosed?
> Identifiers. Name, alias, postal address, unique personal identifier, online identifier, Internet Protocol (IP) address, email address, account name, or other similar identifiers YES YES
> Commercial information. Records of personal property, products or services purchased, obtained, or considered, or other purchasing or consuming histories or tendencies. YES YES
also interesting...
Invested in / partnered with NVIDIA & Hugging Face and others...
- cjonas 3y agoI was just talking to a colleague about the need for a service like this. Their pricing is much cheaper than self-hosting on AWS (ml.g5.48xlarge, needed to run 70B Lamma2, is $20.36/hr). But the TOS makes it completely unviable. If someone can figure out how to standup self-hostable, fine-tuneable models with a serverless architecture, it could be a game changer (allowing devs to use something other than OpenAI/Claude).
- yessen 3y agoWe offer Llama-2-70B-chat api[0] at Deep Infra. $1 per 1M tokens, support streaming and OpenAI compatible endpoint[1]. 0. https://deepinfra.com/meta-llama/Llama-2-70b-chat-hf https://deepinfra.com/meta-llama/Llama-2-70b-chat-hf 1. https://deepinfra.com/docs/advanced/openai_api https://deepinfra.com/docs/advanced/openai_api
- cjonas 3y agoNice, awesome that you can just repoint an OpenAI client to this service. I'll give it a try. Do you have future plans to support fine-tuning via pay-per-token billing? Related: Found an interesting Reddit post (rare) discussing how OpenAI manages to do this by loading the LoRA layer at runtime. https://www.reddit.com/r/MachineLearning/comments/15zl7ul/d_how_do_you_think_open_ai_hosts_all_these_fine/ https://www.reddit.com/r/MachineLearning/comments/15zl7ul/d_...
- benxh 3y agoI've had some success using vast.ai[0] with the Oobabooga LLM WebUI (LLaMA2) instances. One click to start up, minimal editing in the interface settings to enable OpenAI compatible interface. [0] https://cloud.vast.ai/ https://cloud.vast.ai/