4 ms·

I dont get the proposition, they want to build DCs in partnering countries to run GPT on? Who is this useful for, except for OpenAI to get lower latency connect

I dont get the proposition, they want to build DCs in partnering countries to run GPT on? Who is this useful for, except for OpenAI to get lower latency connections to their customers?

eldenring 1y ago
I mean its useful to the customers who get lower latency too.
- john2x 1y ago
  Ah yes, save 100ms for a chat response that takes 10 seconds to generate.
  - lvturner 1y ago
    Today
eksu 1y ago
Not latencies, think data privacy / keeping queries and data from leaving sovereign borders. This way, if there is some local instance / everything is local than the datacenter and service are subject to local laws and regulations (and alternatively you're not subject to foriegn the laws and regulations (and agencies).
- gerash 1y ago
  locality is good for resilience and latency but for privacy? how does it work? How can one audit that the bytes going from a DC in country A to a DC in the US is not the user queries but some telemetry data for example? Presumably you don't get to look at the unencrypted packets
- sReinwald 1y ago
  That's not quite correct. The "sovereignty" pitch here is largely illusory when dealing with a US-based company like OpenAI. The US CLOUD Act (Clarifying Lawful Overseas Use of Data Act) explicitly gives US authorities the power to compel US-based companies to provide data stored on servers, regardless of where those servers are physically located. This effectively undermines any meaningful data sovereignty claims. Consider the actual arrangement being proposed: - OpenAI (US company) maintains control of the infrastructure - OpenAI controls the models and their development - OpenAI maintains the security protocols and access rights - The data merely sits physically within national borders This isn't sovereignty - it's a limited hosting arrangement that remains fully under US legal jurisdiction. US intelligence agencies can still access this data through legal mechanisms that bypass the host country's laws entirely.
  - rany_ 1y ago
    It would also allow OpenAI to operate in countries that have state subsidized electricity and low wages.

I dont get the proposition, they want to build DCs in partnering countries to run GPT on? Who is this useful for, except for OpenAI to get lower latency connections to their customers?

eldenring 1y ago

I mean its useful to the customers who get lower latency too.

john2x 1y ago
Ah yes, save 100ms for a chat response that takes 10 seconds to generate.
- lvturner 1y ago
  Today

eksu 1y ago

Not latencies, think data privacy / keeping queries and data from leaving sovereign borders. This way, if there is some local instance / everything is local than the datacenter and service are subject to local laws and regulations (and alternatively you're not subject to foriegn the laws and regulations (and agencies).

gerash 1y ago
locality is good for resilience and latency but for privacy? how does it work? How can one audit that the bytes going from a DC in country A to a DC in the US is not the user queries but some telemetry data for example? Presumably you don't get to look at the unencrypted packets
sReinwald 1y ago
That's not quite correct. The "sovereignty" pitch here is largely illusory when dealing with a US-based company like OpenAI. The US CLOUD Act (Clarifying Lawful Overseas Use of Data Act) explicitly gives US authorities the power to compel US-based companies to provide data stored on servers, regardless of where those servers are physically located. This effectively undermines any meaningful data sovereignty claims. Consider the actual arrangement being proposed: - OpenAI (US company) maintains control of the infrastructure - OpenAI controls the models and their development - OpenAI maintains the security protocols and access rights - The data merely sits physically within national borders This isn't sovereignty - it's a limited hosting arrangement that remains fully under US legal jurisdiction. US intelligence agencies can still access this data through legal mechanisms that bypass the host country's laws entirely.
- rany_ 1y ago
  It would also allow OpenAI to operate in countries that have state subsidized electricity and low wages.