3 ms·
They already have root. Their software is closed source. There is absolutely nothing stopping them from uploading all of your data right now. If you don't trus
by troad 2y ago
They already have root. Their software is closed source. There is absolutely nothing stopping them from uploading all of your data right now.
If you don't trust the people making your OS, your problems are much deeper than fretting about off-device AI processing.
- __MatrixMan__ 2y agoThat's true, but also it should be possible to make an OS that people can trust without trusting you, and as users we should encourage movement in that direction.
- abtinf 2y ago> should be possible What makes you think this?
- brookst 2y agoIt’s especially funny because I believe it is provably impossible. You’ll have to trust me that I’ve done the proof.
- __MatrixMan__ 2y agoBecause there are so freaking many of us, and some of us trust each other. If we were better at coordinating about which parts of the code we trust and to what degree, we could determine which parts of it are untrustworthy and patch the problem out of it. The GrapheneOS people are doing this, for example. It's not crazy to consider your device vendor as part of your threat model, because like it or not, they are a threat.
- abtinf 2y agoThat’s a good point. It would be interesting if there was a “git blame” style command, but that showed a trust score for every line/block based on who has touched it.
- __MatrixMan__ 2y agoI'm working on a system for data annotation that might support apps of that nature. I'm focusing on simpler datasets for now, I want people to be able to annotate a paper restaurant menu with notes about allergens in a way that other people with those allergens can summon those annotations and steer clear--all without participation from the restaurant. Like an augmented reality layer for text. I hope it grows up into something that would let you ask: > How trusted is this line of code, and by whom?
- EternalFury 2y agoGood luck. It’s much easier to talk about it. The last open OS I have seen reach a semi-mainstream level of adoption was started in the early 90’s, more than 30 years ago, by some Linus guy.
- fastball 2y agoAnd (basically) nobody running linux is individually verifying the source code of every little piece of software that goes into it (maybe Linus is), so you're still trusting someone.
- detourdog 2y agoI can’t even find the appropriate documentation.
- tsimionescu 2y agoHow would documentation help you trust the code?
- detourdog 2y agoHow does one understand what is going on with out a clear set of documentation? Either one is so smart they can review everyline of everything they are running. My contention is that it is hard enough to find authoritative documentation much less developing an understanding of the code needed or running. The choice is either many little trust relationships or a giant leap of faith. I feel better served by a giant leap of faith and access to all the technology I can use. I prefer no documentation and consistent behavior to no documentation and a bunch of internet howtos on what might work.
- dialup_sounds 2y agoIt's all on Discord now.
- troad 2y agoI understand the sentiment, but it's impractical to live in a trust-less society. If you've ever had dental work done, you've put an awful lot of faith in a stranger pushing a drill into your head. Ditto for riding buses and bus drivers, etc etc. Trust can be abused, certainly, but it also allows collaboration and specialisation, and without those I doubt we'd have gotten very far.
- __MatrixMan__ 2y agoI'm happy to trust many kinds of people, dentists included, just not the kind people who find themselves at the helm of companies like Apple and Google. Better to trust many people narrowly (e.g. I don't trust the bus driver to drill my cavities) than to trust a small handful of people broadly (e.g. like Apple expects of their users).
- Aerbil313 2y agoAny kind of practical OS would contain code of unpractical amounts to manually review and audit. That's not to mention the argument that any software of a LOC count of higher than some number is impossible to audit because of complex state handling. Rice's Theorem applies to your brain too, probably, to some extent. Idk about purely functional Haskell though.
- Vegenoid 2y agoWhile true, the gap between "we send your data to our datacenters but we don't look at it" to "we look at it a little bit without telling you" is much smaller than "we leave your data on your device alone" to "we upload data from your device", both on a technical and policy level. Even if the org has been trustworthy to this point, I think this step makes it more likely (maybe still unlikely, but more likely) that in the future they do look at your data, as less things have to change for that to happen.
- deleted 2y ago[deleted]
- jchw 2y agoThat's true, but if you don't update your local software and it isn't currently backdoored, then it won't magically become backdoored without some active involvement somewhere. The trouble with remotely pushing data somewhere is that you can't tell if anything has changed even if you wanted to. (Attestation only works if it's not compromised, and for obvious reasons, there's no way to know that an attestation mechanism is compromised.) That said I really don't disagree with this point at all in terms of it being a valid problem. It's not a fixable problem either (it comes down to, again, building trustworthy computers) but it could be biased way towards being solved whereas today it is still "trust me bro". I don't think Apple will be the company to make progress towards this, though.
- troad 2y ago> if you don't update your local software and it isn't currently backdoored, then it won't magically become backdoored without some active involvement somewhere If you don't update your local software then it will certainly become automatically backdoored by an accumulating series of security vulnerabilities over time. > I don't think Apple will be the company to make progress towards this, though. I agree.
- jchw 2y ago> If you don't update your local software then it will certainly become automatically backdoored by an accumulating series of security vulnerabilities over time. Y'know though, when you put it that way, it sounds inherent that security vulnerabilities will pop up, which is kinda true, at least for the foreseeable future, but to be pedantic, the security vulnerabilities are already there, it's discovering them that's the problem. If we could make secure computers... (time to formally prove everything from the ground up I guess.) But, that said, I wasn't overlooking this, I'm just looping "getting pwned" into "active involvement". If you have some sufficiently isolated machines, they're probably fine indefinitely. The practicality of this is limited outside of thought experiments. However it's definitely worth noting that unlike a compromised remote, it is at least technically feasible to work on the problem of making local compromise more evident, whereas a remote compromise is truly impossible to reliably be able to detect from the outside.