4 ms·
Hmm. Given the amount of information removed (justifiably so), there isn't much left to analyze other than aggregates. (Which the dashboard mockup in the post a
by minimaxir 10y ago
Hmm. Given the amount of information removed (justifiably so), there isn't much left to analyze other than aggregates. (Which the dashboard mockup in the post already does)
What might be interesting is graphing a network of the relationship between services which suffered a breach. Fortunately, I have the proper workflow prepared to process the data in this manner, so I'll take a look.
- drvdevd 10y agoSo it would appear the most interesting data point on these records is the date and time of the breach discovery, or using that to estimate a breach date? Correlating that with some other publicly available data sets (e.g.: historical routing data) might yield some useful results?
- thaumaturgy 10y agoYeah. I would've rather had a dump of just the passwords -- no usernames, site names, service names, counts, deduplication, just 1.4 billion passwords, one password to a line. I'd feed it into my bad-password-indexing program (https://github.com/robsheldon/bad-passwords-index https://github.com/robsheldon/bad-passwords-index) and it would spit out a file that could be used to improve password security in a not-entirely-stupid way somewhere.
- ComodoHacker 10y agoAlso that's exactly what malicious actors would want to improve their dictionaries, to brute-force poorly-hashed dump from the next breach.
- NKCSS 10y agoThere are enough plain-text password lists for that, rockyou (old but good) and there are many more. Kali distro has some of them shipped if you are interested, and many more can be found online.
- thaumaturgy 10y agoThat's a tool they already have plenty of access to. I've tried to make a tool that will work against them, making it possible for any service, running any software stack, to efficiently blacklist hundreds of thousands of common passwords. I can (and should) start tracking down more password dumps and compiling them myself to do the same thing, but I've been spread pretty thin for a while. It's been on my mind but there hasn't been time for it. A massive list of plaintext passwords from Troy's dump, the ones that were available anyway, would have been really convenient. Odds are my index file would already be updated to a newer version.
- koolba 10y agoI thought all his data came from publicly available dumps. If so, it might make it easier to for them to have it all in one place, but it's not like he's giving them anything they can't get if they really wanted it (and probably have already).
- lorenzhs 10y agoNo, it also contains non-public dumps that someone gave to him (after authentication) iirc. But he never pays for dumps. I think he posted an explanation on his blog a while ago.
- NKCSS 10y agoIt's not all plain-text pwd's ofcource; a lot of the records (thankfully) have had hashed passwords.
- minimaxir 10y agoAlright, made a first draft illustration of the relationship: http://i.imgur.com/FpLiFGk.png http://i.imgur.com/FpLiFGk.png I might be onto something. It appears the communities algorithm correctly detected the Russian and China communities.
- flashman 10y agoYou know, this is exactly where my mind went, too: http://i.imgur.com/fME7MK7.png http://i.imgur.com/fME7MK7.png The difference between your first draft[1] and mine is that I've only included links where each site had at least 1% of users in the other site. This helps make links more meaningful. For instance, about 37k users were members of both Tumblr and Plex. Tumblr had the largest number of Plex users, so it should be a strong link, right? No: because Tumblr has such a large userbase, this is a relatively insignificant relationship; 0.14% of Tumblr users had Plex accounts, which ranks only 20th for Plex. Compare this to Plex and Xbox-Scene. 5.6k users had Plex and Xbox-Scene accounts, which is about 2% of each site's userbase. I believe this link is much more meaningful than the Plex-Tumblr link, and I believe my visualisation bears this out. [1]http://i.imgur.com/FpLiFGk.png http://i.imgur.com/FpLiFGk.png * Note: since I ignored all lines with only one site, this "1%" only includes users who were in more than one breach!
- minimaxir 10y agoYes, that sounds like a sane optimization compared to my black-gray mess.