5 ms·

No you didn't. The whole point of using Azure OpenAI over plain OpenAI is the fact that your data doesn't get donated to OpenAI for training (this solves "comp

No you didn't. The whole point of using Azure OpenAI over plain OpenAI is the fact that your data doesn't get donated to OpenAI for training (this solves "compliance" for enterprise customers that need it), which you're not solving (because you obviously can't run the OpenAI models in your own data center).

Jayakumark 3y ago
+1
j45 3y ago
The Azure OpenAI API to me was more about reliability and minimizing downtime. The OpenAI API also allows opting out of training the OpenAI for training. If you are referring to something else with data, happy to learn. https://help.openai.com/en/articles/5722486-how-your-data-is-used-to-improve-model-performance https://help.openai.com/en/articles/5722486-how-your-data-is... "API OpenAI does not use data submitted to and generated by our API to train OpenAI models or improve OpenAI’s service offering. In order to support the continuous improvement of our models, you can fill out this form to opt-in to share your data with us. "
droidno9 3y ago
OpenAI also does not use API data to train its models. Source: https://openai.com/enterprise-privacy https://openai.com/enterprise-privacy
- kordlessagain 3y ago
  Needs more attention. Anything that replicates ChatGPT using OpenAI APIs is valuable because of this fact for enterprise use cases. https://mitta.ai https://mitta.ai uses these API calls, has an Open Source code base for inspection, a strong user privacy policy, and doesn't store data in transit, other than documents that are uploaded. I'm working on TTLs for the files stored, so there is no data left behind (other than what might be stored by the user in the DB).
danenania 3y ago
According to OpenAI, they don't use data sent to the API for training and delete it after 30 days. So your concern is misplaced unless you think OpenAI is outright lying about their policies.
- happytiger 3y ago
  Whoa there. That’s only half the story. https://techcrunch.com/2023/03/01/addressing-criticism-openai-will-no-longer-use-customer-data-to-train-its-models-by-default/ https://techcrunch.com/2023/03/01/addressing-criticism-opena... They said only if they opt in not that they wouldn’t do it. And they used to and could change those terms again after the market matures and developers have deeply integrated application investments. Plenty of companies have followed this strategy in the past. Let’s not oversimplify the situation as it was a recent change as well…
  - kristjansson 3y ago
    That's only for ChatGPT. The APIs are governed by [0] > We will only use Customer Content as necessary to provide you with the Services, comply with applicable law, and enforce OpenAI Policies. We will not use Customer Content to develop or improve the Services. [0]: https://openai.com/policies/business-terms https://openai.com/policies/business-terms
    - deleted 3y ago
      [deleted]
    - voiceblue 3y ago
      That language seems to be doing a lot of heavy lifting. A more straightforward phrasing would've been "we will never process or otherwise consume customer content once it has been delivered to you". As written, they could use it to train GPT-5 or what-have-you and refuse to share it with you, making that exempt as it is apart from "services". Or all manner of other shenanigans, if they have competent lawyers.
      - 3y ago
ajcp 3y ago
Many here think that I'm afraid of my companies data being used to train models, but that is only half-correct. The value proposition of Azure OpenAI to the enterprise is that it's bound by the Enterprise Agreement for not just data-use, but data access writ-large. I don't want my data to be accessible for *any reason* by a vendor that isn't covered explicitly in the EA. While OpenAI says they delete your data after 30-days I have no contract or agreement in place that ensures that, or that within those 30-days they don't have carte blanche to my data for whatever else they may want to do with it. The Azure OpenAI agreement *explicitly* states they only store my data for 30-days and can *only* access it if they suspect abuse of the service according to the ToC and our EA, which is no different than for other Azure services on my tenant. IIRC that's only after notifying me as well, and cannot exfiltrate that data even if they access it.
- gigel82 3y ago
  I suspect a lot of folks never worked with Enterprise / Gov customers and don't understand the restrictions and compliance requirements (like data residence, access control, FedRAMP, TISAX, reliability SLAs, etc. which you get with Azure but not with some "move fast and break things" startup like OpenAI). My comment is not dissing on the author, I'm just pointing out what most folks get from Azure is compliance (and maybe safety), and an OSS cannot solve that (unless they're running some other models in owned infrastructure or on-prem).
  - quickthrower2 3y ago
    Even just doing SOC2 we prefer it Let alone if you are a SaaS your customers may demand it.
  - robertlagrant 3y ago
    > most folks get from Azure is compliance To be fair, this doesn't prevent problems. Paperwork doesn't plug any security gaps in any cloud provider.
    - toomuchtodo 3y ago

Jayakumark 3y ago

j45 3y ago

The Azure OpenAI API to me was more about reliability and minimizing downtime. The OpenAI API also allows opting out of training the OpenAI for training. If you are referring to something else with data, happy to learn. https://help.openai.com/en/articles/5722486-how-your-data-is-used-to-improve-model-performance https://help.openai.com/en/articles/5722486-how-your-data-is... "API OpenAI does not use data submitted to and generated by our API to train OpenAI models or improve OpenAI’s service offering. In order to support the continuous improvement of our models, you can fill out this form to opt-in to share your data with us. "

droidno9 3y ago

OpenAI also does not use API data to train its models. Source: https://openai.com/enterprise-privacy https://openai.com/enterprise-privacy

kordlessagain 3y ago
Needs more attention. Anything that replicates ChatGPT using OpenAI APIs is valuable because of this fact for enterprise use cases. https://mitta.ai https://mitta.ai uses these API calls, has an Open Source code base for inspection, a strong user privacy policy, and doesn't store data in transit, other than documents that are uploaded. I'm working on TTLs for the files stored, so there is no data left behind (other than what might be stored by the user in the DB).

danenania 3y ago

According to OpenAI, they don't use data sent to the API for training and delete it after 30 days. So your concern is misplaced unless you think OpenAI is outright lying about their policies.

happytiger 3y ago
Whoa there. That’s only half the story. https://techcrunch.com/2023/03/01/addressing-criticism-openai-will-no-longer-use-customer-data-to-train-its-models-by-default/ https://techcrunch.com/2023/03/01/addressing-criticism-opena... They said only if they opt in not that they wouldn’t do it. And they used to and could change those terms again after the market matures and developers have deeply integrated application investments. Plenty of companies have followed this strategy in the past. Let’s not oversimplify the situation as it was a recent change as well…
- kristjansson 3y ago
  That's only for ChatGPT. The APIs are governed by [0] > We will only use Customer Content as necessary to provide you with the Services, comply with applicable law, and enforce OpenAI Policies. We will not use Customer Content to develop or improve the Services. [0]: https://openai.com/policies/business-terms https://openai.com/policies/business-terms
  - deleted 3y ago
    [deleted]
  - voiceblue 3y ago
    That language seems to be doing a lot of heavy lifting. A more straightforward phrasing would've been "we will never process or otherwise consume customer content once it has been delivered to you". As written, they could use it to train GPT-5 or what-have-you and refuse to share it with you, making that exempt as it is apart from "services". Or all manner of other shenanigans, if they have competent lawyers.
    - 3y ago

ajcp 3y ago

Many here think that I'm afraid of my companies data being used to train models, but that is only half-correct. The value proposition of Azure OpenAI to the enterprise is that it's bound by the Enterprise Agreement for not just data-use, but data access writ-large. I don't want my data to be accessible for *any reason* by a vendor that isn't covered explicitly in the EA. While OpenAI says they delete your data after 30-days I have no contract or agreement in place that ensures that, or that within those 30-days they don't have carte blanche to my data for whatever else they may want to do with it. The Azure OpenAI agreement *explicitly* states they only store my data for 30-days and can *only* access it if they suspect abuse of the service according to the ToC and our EA, which is no different than for other Azure services on my tenant. IIRC that's only after notifying me as well, and cannot exfiltrate that data even if they access it.

gigel82 3y ago
I suspect a lot of folks never worked with Enterprise / Gov customers and don't understand the restrictions and compliance requirements (like data residence, access control, FedRAMP, TISAX, reliability SLAs, etc. which you get with Azure but not with some "move fast and break things" startup like OpenAI). My comment is not dissing on the author, I'm just pointing out what most folks get from Azure is compliance (and maybe safety), and an OSS cannot solve that (unless they're running some other models in owned infrastructure or on-prem).
- quickthrower2 3y ago
  Even just doing SOC2 we prefer it Let alone if you are a SaaS your customers may demand it.
- robertlagrant 3y ago
  > most folks get from Azure is compliance To be fair, this doesn't prevent problems. Paperwork doesn't plug any security gaps in any cloud provider.
  - toomuchtodo 3y ago