4 ms·
The openness is laudable, but I'd seen this phrase from them before around cloudbleed: "We didn’t find evidence of exploitation" It just doesn't mean much. Th
by tyingq 8y ago
The openness is laudable, but I'd seen this phrase from them before around cloudbleed: "We didn’t find evidence of exploitation"
It just doesn't mean much. They had something like 2 weeks worth of logs. And further, they never explicitly stated that the logs had enough context to show if it was being exploited. That is, are there any fields in the log files that could distinguish normal uri accesses from malicious ones?
I'm curious if that's all deliberately careful wording because they know, that they "don't know".
- lioeters 8y agoIndeed, "Absence of evidence is not evidence of absence."
- lkbm 8y agoA popular quote that's usually wrong. It's true iff you haven't made any effort to find evidence whatsoever OR there's a zero percent chance that you would find evidence even if it existed. This is a very rare circumstance, and one that doesn't apply in this case. There were some logs that. had there been exploitation, had a non-zero change of providing evidence of said exploitation. They looked in the logs, and there's a non-zero chance that, if that evidence were in those logs, they would have seen it. P(exploitation) < P(exploitation|they had and looked at the logs) That's the definition of evidence.
- jgrahamc 8y agoThe blog I linked to (about the data analysis we did) talks about the different data sources we used. We had the sampled logs (which you mention), plus statistical data on traffic through individual sites, plus crash logs. A lot more than "2 weeks worth of logs".
- tyingq 8y agoThat's helpful, thank you. However, I'm not conjuring the "2 weeks worth of logs" phrase out of thin air: https://blog.cloudflare.com/quantifying-the-impact-of-cloudbleed/ https://blog.cloudflare.com/quantifying-the-impact-of-cloudb... "We have the logs of 1% of all requests going through Cloudflare from 8 February 2017 up to 18 February 2017 (when the vulnerability was patched)...Requests prior to 8 February 2017 had already been deleted."
- jgrahamc 8y agoSorry, if it came across as me implying you pulled that from thin air. One of the most interesting things we had was the core dumps. Randomnly (depending on memory state) we'd crash rather than dump out memory in the HTTP response. We had all that data going back over the entire period. That gave us a lot of confidence this hadn't been exploited because we could see the rate of crashes plus we could see the actual core dumps to see the memory state when the crash happened.
- tyingq 8y agoAhh. That's more comforting. So, any wide scale deliberate exploitation would have resulted in an obvious spike of crash dumps. That leaves whatever the scale of passively trolling, say, Google's cache might have been. Unknown, but probably not huge.
- jgrahamc 8y agoRight. Which was one of the reasons we used YARA on all the data we pulled from Google and other caches so we could extract the leaked data and categorize it. Then we called all the affected customers (I did a lot of those calls personally) and offered to give them the leaked information so they could look for exploitation. The idea being that if they had seen some anamoly with something that we knew was in Google's cache then it would be evidence of exploitation that way.
- dorianm 8y agoI'm curious why those core dumps, lasting for months at least, were not investigated
- jgrahamc 8y agoEnjoy my "Inside Cloudbleed" RSA talk: https://www.rsaconference.com/videos/inside-cloudbleed https://www.rsaconference.com/videos/inside-cloudbleed I talked about that and much more there.
- rybosome 8y agoThey are probably pretty conscious of legal liability. I participated in the investigation of a potential vulnerability at one point in my career, and I was advised to use similar wording at the conclusion of the investigation.