3 ms·

I may have missed it, but the article doesn't discuss privacy or if the questions/answers can be used for training purposes. Using Chat GPT for government stuff

I may have missed it, but the article doesn't discuss privacy or if the questions/answers can be used for training purposes. Using Chat GPT for government stuff isn't, in itself, a problem, but those assurances have to be iron clad, or you could see massive information leakage.

crayboff 3y ago
I've worked at companies who sell software to state governments. They usually run sensitive software in their own servers with no external internet access. We would have to send someone onsite to perform their upgrades or send detailed list of instructions so they can resolve the issues themselves. I suspect Microsoft would do something similar, no data would leave government property.
- Oras 3y ago
  that would be extremely expensive. Running and maintaining GPUs enough to run GPT4 inside each building. Doesn’t AWS have a gov offering? I would assume MS can have similar offering with Azure using their express route.
  - mcmcmc 3y ago
    Yep. Both have gov cloud offerings that live in their own datacenters completely segregated from the public cloud side. There's even a gov cloud version of Microsoft 365.
  - messe 3y ago
    > Doesn’t AWS have a gov offering? More than that, they even have an air-gapped regions for more sensitive purposes, where you need not only to be a US citizen, but also a certain level of security clearance to access. As an (now ex-) AWS SDE working outside of the US, those regions were a pain in the ass to bring up your service in (as was govcloud, but that wasn't nearly as bad—at least there the ops guys could share logs and screenshots without having to work around an airgap) The ops guys with direct access to those regions had to be on-site, as they only had access from a limited number of locations, and they were often severely understaffed. They were a pleasure to work with, but you could be waiting a day or more to find out your deployment had failed (the longest SLA I had to deal with in my time there was ~2 weeks due to some unfortunate vacation timings over the summer).
philote 3y ago
Looks like you missed it: "Chappell wrote that because Microsoft hosts the models in its Azure infrastructure, any data sent to them stays within the Azure OpenAI service, and added that data from Azure Government customers won’t be used to train the AI models."

crayboff 3y ago

I've worked at companies who sell software to state governments. They usually run sensitive software in their own servers with no external internet access. We would have to send someone onsite to perform their upgrades or send detailed list of instructions so they can resolve the issues themselves. I suspect Microsoft would do something similar, no data would leave government property.

Oras 3y ago
that would be extremely expensive. Running and maintaining GPUs enough to run GPT4 inside each building. Doesn’t AWS have a gov offering? I would assume MS can have similar offering with Azure using their express route.
- mcmcmc 3y ago
  Yep. Both have gov cloud offerings that live in their own datacenters completely segregated from the public cloud side. There's even a gov cloud version of Microsoft 365.
- messe 3y ago
  > Doesn’t AWS have a gov offering? More than that, they even have an air-gapped regions for more sensitive purposes, where you need not only to be a US citizen, but also a certain level of security clearance to access. As an (now ex-) AWS SDE working outside of the US, those regions were a pain in the ass to bring up your service in (as was govcloud, but that wasn't nearly as bad—at least there the ops guys could share logs and screenshots without having to work around an airgap) The ops guys with direct access to those regions had to be on-site, as they only had access from a limited number of locations, and they were often severely understaffed. They were a pleasure to work with, but you could be waiting a day or more to find out your deployment had failed (the longest SLA I had to deal with in my time there was ~2 weeks due to some unfortunate vacation timings over the summer).

philote 3y ago

Looks like you missed it: "Chappell wrote that because Microsoft hosts the models in its Azure infrastructure, any data sent to them stays within the Azure OpenAI service, and added that data from Azure Government customers won’t be used to train the AI models."