4 ms·
You're presenting one situation: someone else's code running in the user's environment. But what about running the user's code in someone else's untrusted envir
by wmf 6y ago
You're presenting one situation: someone else's code running in the user's environment. But what about running the user's code in someone else's untrusted environment?
- akersten 6y agoIn my opinion, the idea there is the same as it's always been: don't trust the client.
- lxgr 6y agoSGX is mostly about servers, not clients.
- matheusmoreira 6y ago> someone else's untrusted environment That "someone else" should have the same powers over their machines that users do. They should be allowed to see everything and tamper with anything. After all, the computer is theirs. Other people's computers should always be untrusted.
- johncolanduoni 6y agoDo you feel the same way about cloud providers? Should they always be able to see everything and tamper with anything for the workloads their users run? If that’s the case, would you be in favor of making contracts to that effect (as already exist for all cloud providers I’m aware of) unenforceable?
- matheusmoreira 6y agoI agree that trusted computing can be a good thing for cloud computing providers. They own the computer hardware but other people are paying them in order to use those resources. That's the entire point of cloud computing. The user and owner of the hardware are different people and so offering trusted computing as a feature makes sense. Consumers are the opposite: they pay companies in order to use their software on their computers. The owner and user of the machine are the same person. Users should get to maintain complete control over the hardware, including the ability to reverse engineer the software and even make "unauthorized" copies of anything they want. I don't trust that this technology will be restricted to cloud computing though. The copyright industry is worth billions of dollars. They'll make use of it on consumer machines if it's available. This is something that should be prevented at all costs, since the worst case scenario is a world where all commercial software runs in a secure execution environment where the user has no control. Threat models where the user is an adversary are obviously user hostile. So of course whenever these technologies are compromised it is a victory for software freedom.
- lxgr 6y ago> Users should get to maintain complete control over the hardware, including the ability to reverse engineer the software Secure enclaves and auditable software are not mutually exclusive. It's totally possible to run open source software in an enclave! > the worst case scenario is a world where all commercial software runs in a secure execution environment where the user has no control. This would be a very bad scenario indeed, but I consider it completely unrealistic. The trusted computing base of an entire graphical computing device including its operating system and all installed applications is absolutely impossible to audit. It didn't work for Microsoft (Palladium), and it's also not the direction that Apple is going, arguably one of the most restrictive client platforms today. Practical trusted computing are tiny (and ideally heavily sandboxed!) trusted enclaves running the least amount of critical, audited code.
- lxgr 6y agoYou're of course free to hold that view. But if you were a cloud service provider, I'd give my data and money to the competition (assuming I believe their claims regarding trusted computing).
- Spivak 6y agoOkay sure, but that still leaves the problem me sending you (someone untrusted) my code and asking for proof that it's running unmodified. Such a thing would let me trust your computer as my own if you allow it.
- saurik 6y agoWe have mathematical techniques for this--such as ZKSTARK--that allow for the construction of proofs while not also hiding the execution from the user. Showing you "I did this correctly" should not imply being unable to watch it happen and decide to put a stop to it if you don't like what it was doing.
- Spivak 6y agoBut it does? That's a fairly narrow definition of "watching it happen" when both the real computations and the data are hidden from you. Have you gained anything except fewer practical uses? I mean at the end of the day wouldn't it be nice to be able to use a cloud service and be sure that server is running exactly the published source and your secrets are hidden? That the trust-domain of your phone can extend into a datacenter?
- lxgr 6y agoI'm not familiar with ZKSTARK, but does it allow running computations in a trusted way without revealing some of the input parameters? The latter constraint is something that I think is usually not addressed by zero knowledge proofs but rather only trusted computing (or the software equivalent, whitebox cryptography, assuming it exists).
- sterlind 6y agoThis can be accomplished, completely generically, by running a Turing machine using fully-homomorphic encryption, and providing only the bootstrap/evaluation key, but not the encryption/decryption keys. (Note: you have to use a Turing machine rather than some application-specific circuit, or someone can use a circuit-bending attack to tamper with the data.) Unfortunately, this is infeasible even by FHE standards, and doesn't let the user get an output non-interactively.. might as well run it on your local machine. But the sorts of things SGX does may one day be doable with only high-powered maths, if we get good functional encryption or program obfuscation.
- pmontra 6y agoI'm more concerned about this scenario: running my program A on my machine side by side with somebody's else program B that I don't fully trust. Your scenario looks like the authors of program B not trusting me. Sorry for them but it's my machine.