7 ms·
But if the code is open source, we _can_ verify it's security? Heartbleed and Shellshock, the two most significant vulnerabilities found in heavily used open s
by simonh 11y ago
But if the code is open source, we _can_ verify it's security?
Heartbleed and Shellshock, the two most significant vulnerabilities found in heavily used open source software, were found by vulnerability testing and not code inspection. So while being open source is a nice-to-have attribute for a piece of software, that's as far as it goes. Painting open source as being a magical wand that wishes away all our security troubles is completely out of order.
Edit: I'll go further. It's become dismayingly apparent that very little systematic code review of open source software in order to secure it is actually taking place. It now seems quite possible that the most thorough investigations of software vulnerability, via code analysis or any other techniques, are carried out by those wishing to exploit them. They are well funded and highly motivated. Looked at in that light, the balance may well tip towards open source actually increasing the likelihood of software vulnerabilities being exploited maliciously.
The open source community has a long way to go if it's going to clearly demonstrate that it's model is advantageous, and complacent pronouncements of it's assumed superiority like this aren't going to achieve that.
- pekk 11y agoDo you understand the concept of "necessary, but not sufficient"?
- simonh 11y agoYes I do, but that's not what the post I was responding to was saying. However I have not seen any arguments that convince me if its necessity. Furthermore were talking about third party services. What code they open sourcezsndcegat code they actually run on their servers are two different questions. Open source doesn't solve this problem whichever way you slice it.
- dspillett 11y agoIf the source is open you can verify/test both ways, if it isn't then you only have the external testing option. The code being publicly available does not guarantee security but makes insecurity easier to find which on balance indirectly increases security.
- qznc 11y agoA verification of security is always based on an attacker model. There is no general security. The actual point is not security, but trust and certainty. Being Open Source does not change whether some messaging app is secure or not. It changes our knowledge about the code. It also makes me have a little bit more trust in some company for revealing their stuff. Even if WhatsApp open-sources the clients, there is still the problem of US jurisdiction. NSA can force them to silently including a backdoor or send everything to NSA-servers. Trust is a difficult thing.
- geofft 11y ago"Open source" isn't quite the right term, but it's on the right track. What you definitely don't need is permission to redistribute, modify, etc. the software. Those are important for user freedom, but for the goal of verifying that a particular app on a walled-garden app store does what it claims to do, those don't help you. You just need access to source code. What you do need, whether or not you have source, is an understanding of what the software does. Sure, you can probably do this by disassembling the software. But if you can disassemble the software and understand it, there is nothing more that having the actual source would tell you. If the company is expecting that people will disassemble it to verify it, they might as well release source. What you also need, given either source or a binary, is assurance that everyone else is running the same binary as you have. Given source, that probably requires reproducible builds and a documented and reasonable build chain. Given a binary, that requires some distribution mechanism that ensures that everyone in fact gets the same binary.
- lmm 11y ago> But if the code is open source, we _can_ verify it's security? No - the code could be "open source" but unreadable. But if it's not open-source there's definitely nothing we can do. > Heartbleed and Shellshock, the two most significant vulnerabilities found in heavily used open source software, were found by vulnerability testing and not code inspection. So while being open source is a nice-to-have attribute for a piece of software, that's as far as it goes a) afl-fuzz and the like require access to the source code. b) Those were the vulnerabilities that made it into production. They tell you nothing about what proportion of potential vulnerabilities were stopped by it being open source.
- wglb 11y agothere's definitely nothing we can do. This is very much not true. Understanding what any executable does is possible without the source code. In fact, if you are looking at the binary, you know exactly what you are dealing with, and don't have the doubt about what the build chain actually does with the source. potential vulnerabilities were stopped by it being open source. This presumably comes from "many eyes make all bugs shallow". But operationally this is not true, because there isn't really, except for rare circumstances, any useful review.
- baby 11y agonote that Heartbleed was not discovered via fuzzing.
- simonh 11y agoThanks for the correction regarding ali-fuzz, I wasn't aware of that. Unfortunately I can't update my post to fix that anymore. I think this doesn't fundamentally change my point though. ali-fuzz was used to find shellshock, but that vulnerability had been in bash for decades. If it had ben found and closed within months of being introduced I'd be cheering the advantages of open source with the best of them, but that's decades during which a bad actor could theoretically have found and exploited that vulnerability with impunity using code analysis. That's exactly what I mean by the balance of advantages versus disadvantages of open source being tipped the wrong way right now. I'm not enemy of open source, far from it, I'm just arguing for an open and honest assessment of the situation. If open source is really going to be a genuine security advantage, there's an awful lot of work to be done to make it so. It's not going to happen spontaneously.
- phosphore 11y ago"Rogues are very keen in their profession, and know already much more than we can teach them" said locksmither Alfred Charles Hobbs, who in 1851 demonstrated to the public how state-of-the-art locks could be picked, in response to concerns that exposing security flaws in the design of locks could make them more vulnerable to criminals. This quote is not less true today when applied to blackhats. Open source doesn't mean secure, but security trough obscurity is not a good security model.
- dave2000 11y ago"The open source community has a long way to go if it's going to clearly demonstrate that it's model is advantageous" How is it less safe than not having the source, though? Absent the source, how can you trust that the once trustworthy, if secret, code hasn't been nobbled via hackers, a court order etc. The model of security through obscurity is what's broken, and that's what we've got here. You have to trust Facebook today, and forever and trust anyone else with the technical or legal power to silently violate its security; something that's much harder if the code is available for analysis.
- tptacek 11y agoIt's not less safe to have the source code. Source code is a good thing. All things being equal, I prefer open source components too. But all things are not equal. In this case, if you're ideologically attached to open source, you're in luck: the cryptographic components WhatsApp uses are open source, and there's another good messenger that uses them: Signal, by Open Whisper Systems.
- dave2000 11y agoThe problem with WhatsApp is that IT is not open source, so you only have facebook's say-so that they're using the signal code, and you have to have faith that they've implemented it securely, and you have to trust that, as an american company, the current or future government won't silently compel them to introduce a weakness, such as allowing that when a phone gets the message `sing` it sends an encrypted copy of the last n messages back to facebook. I'd be more comfortable using the compilable, open source signal app, because i at least have the opportunity to see what the code is doing, should i somehow manage to find an sabotaged version of clang, gcc, vs etc.
- tptacek 11y agoPeople need to stop writing this exact comment. Even if you're right about open source and security, you can't be right about it for this reason, because this comment is false. You are not in fact stuck with Facebook's "say-so" about what WhatsApp is doing. Obviously, if you have the executable binary, you can straightforwardly validate its functionality with a disassembler/decompiler. There are thousands of people that do this professionally. There might be some other reason why it's important that WhatsApp's code be published, but it can't possibly be this one.
- davexunit 11y ago>The open source community has a long way to go if it's going to clearly demonstrate that it's model is advantageous Some in the open source community flout the "many eyes makes all bugs shallow" argument, but in the free software community we do not assert this. Part of security is transparency, and this means being able to read the source code, freedom 1. Free software is a prerequisite for secure software that a user can trust.
- tptacek 11y agoI understand and respect the tenets of your religion, but I do not practice that religion myself.
- belorn 11y agoBe civil. Don't say things you wouldn't say in a face-to-face conversation. Avoid gratuitous negativity. - Hacker News Guidelines If you are opening up for incivility, I doubt there is an end what people will start calling each other. Do you really want to go down that road?
- davexunit 11y agoThanks for being condescending.
- tptacek 11y agoIf it helps you understand where I'm coming from, while I do in fact admire the FSF's ethic of free software, more so than I admire "open source", as a practitioner in the field of cryptographic security I find FSF-style preaching about security to be intensely condescending as well. More here: https://news.ycombinator.com/edit?id=11455588 https://news.ycombinator.com/edit?id=11455588
- davexunit 11y agoThe linked comment has NOTHING to do with what the FSF has said about software security.
- kzhahou 11y agoWhen the source code has a whitelist of usernames for which encryption should be disabled, put there under court order, you'll see the difference between external verification vs source code inspection.
- tptacek 11y agoI really think that's what most people arguing against WhatsApp believe: that a backdoor in a secure messaging application would take the form of intelligible source code expressing directly that backdoor. Obviously, a WhatsApp backdoor would not in fact take that form.
- belorn 11y agoIf you want to compare track records of close sources software with open source, we have IE6 and flash. We have windows 98 and XP. We have every snake oil product ever sold that the producer knew wasn't safe but sold anyway. Heartbleed and Shellshock were big bugs, but they did not create the concept of botnets nor was they so successful that they created a market where before there wasn't.
- tptacek 11y agoSo basically the theory here is that if you look back to software written in the mid-to-late 1990s, you tend to find insecure software.
- belorn 11y agoIf you want to be like that, all of them were written mid-to-late 1990 or before it: Bash was released in 1989 and initially development started some time before that. OpenSSL project was founded in 1998. Windows XP was initial developed in the late 1990s, released 2001. Macromedia Flash 1.0 was released 1996 and initially developed a couple years before. So should we only count software vulnerabilities that was created after 2010? 2016? What proof would satisfy you?
- tptacek 11y agoI'm really not sure what point you're trying to make here, because obviously both Bash and OpenSSL are poster children for the perils of legacy insecure software, and both are still in wide use --- far wider than Windows XP!
- belorn 11y agoAre you confused by the parent argument that Heartbleed and Shellshock is proof that open source has the same likelihood of software vulnerabilities being exploited maliciously as closed software? Or are you confused by your own argument that software written in the mid-to-late 1990s tend to be insecure software, and thus we should disregard that some software has been more exploited historically than others?
- agumonkey 11y ago> But if the code is open source, we _can_ verify it's security? But if the code is not open source, we _cannot_ verify it's security? Ability is already good. Not enough but necessary.
- tptacek 11y agoWhy do you believe that we _cannot_ verify its security?
- agumonkey 11y agoI mean closed sources are .. closed sources (did I say something stupid?). Unless you consider black box testings or things I don't know.
- tptacek 11y agoThe original source code is unavailable. But the assembly code that actually implements the program is not, and there are a variety of techniques reversers use to lift assembly into higher-level representations --- not that you'd need to in this case.