8 ms·
Some observations on this file: 0. This is a file of SHA1 hashes of short strings (i.e. passwords). 1. There are 3,521,180 hashes that begin with 00000. I be
by jgrahamc 14y ago
Some observations on this file:
0. This is a file of SHA1 hashes of short strings (i.e. passwords).
1. There are 3,521,180 hashes that begin with 00000. I believe that these represent hashes that the hackers have already broken and they have marked them with 00000 to indicate that fact.
Evidence for this is that the SHA1 hash of 'password' does not appear in the list, but the same hash with the first five characters set to 0 is.
5baa61e4c9b93f3f0682250b6cf8331b7ee68fd8 is not present
000001e4c9b93f3f0682250b6cf8331b7ee68fd8 is present
Same story for 'secret':
e5e9fa1ba31ecd1ae84f75caaa474f3a663f05f4 is not present
00000a1ba31ecd1ae84f75caaa474f3a663f05f4 is present
And for 'linkedin':
7728240c80b6bfd450849405e8500d6d207783b6 is not present
0000040c80b6bfd450849405e8500d6d207783b6 is present
2. There are 2,936,840 hashes that do not start with 00000 that can be attacked with JtR.
3. The implication of #1 is that if checking for your password and you have a simple password then you need to check for the truncated hash.
4. This may well actually be from LinkedIn. Using the partial hashes (above) I find the hashes for passwords linkedin, LinkedIn, L1nked1n, l1nked1n, L1nk3d1n, l1nk3d1n, linkedinsecret, linkedinpassword, ...
5. The file does not contain duplicates. LinkedIn claims a user base of 161m. This file contains 6.4m unique password hashes. That's 25 users per hash. Given the large amount of password reuse and poor password choices it is not improbable that this is the complete password file. Evidence against that thesis is that password of one person that I've asked is not in the list.
- dpritchett 14y agoFor the security novices amongst us: I had no idea how to do this so I figured out a quick python script to test it: >>> from hashlib import sha1 >>> def check_pass(plaintext, offset=5): hashed = sha1(plaintext).hexdigest() return (hashed, '0' * offset + hashed[offset:]) >>> check_pass("linkedin") ('7728240c80b6bfd450849405e8500d6d207783b6', '0000040c80b6bfd450849405e8500d6d207783b6') Edit: I'm pretty sure JtR refers to this: http://en.wikipedia.org/wiki/John_the_Ripper http://en.wikipedia.org/wiki/John_the_Ripper
- peterwwillis 14y agoObligatory perl one-liner: perl -MDigest::SHA -le '$h = substr( Digest::SHA::sha1_hex($ARGV[0]) , 5 ); open F, "<combo_not.txt"; do { print "found $_" if grep(/$h/, $_) } while (<F>)' password (for people without shells)
- jgrahamc 14y agoObligatory shell one-liner: grep `echo -n password | shasum | cut -c6-40` hacked.txt
- dpritchett 14y agoHere's node.js: $ echo linkedin | xargs node -e "var x = require('crypto').createHash('sha1').update(process.argv[1]).digest('hex'); console.log([x, '00000' + x.substring(5)]);" 7728240c80b6bfd450849405e8500d6d207783b6 0000040c80b6bfd450849405e8500d6d207783b6
- zxcvb 14y agoThe perl one liner was funny, the shell one liner was light hearted, but your node solution is just pure fanboyism and quite frankly not in line with the spirit of the two previous posts.
- jgrahamc 14y agoAnd.. the node.js solution doesn't do what either the Perl or shell one liners do. It doesn't tell you whether the password was found in the file. All it does is print out a SHA1 hash of a string.
- dpritchett 14y agoThat's a trivial modification: $ echo linkedin | xargs node -e "var x = require('crypto').createHash('sha1').update(process.argv[1]).digest('hex'); console.log(x.substring(5));" | xargs -I {} grep {} hashes.txt I'm surprised at the backlash to what I thought was fun code golfing. No one called me names after I posted a simple Python solution that didn't check the file. For what it's worth I've changed my LI password and I haven't bothered downloading the actual hash file.
- d503 14y agoIf you're paranoid about shoulder-surfing you can use getpass to hide your password as you type it in. >>> import getpass >>> password = getpass.getpass('Password: ') http://docs.python.org/library/getpass.html http://docs.python.org/library/getpass.html
- grantismo 14y agoCommand line utility I wrote which uses getpass: http://dpaste.com/hold/756011/ http://dpaste.com/hold/756011/
- mas1n 14y agoA complete python script assuming you have hashes.txt in the same directory. http://dpaste.com/756007/ http://dpaste.com/756007/
- deleted 14y ago[deleted]
- deleted 14y ago[deleted]
- SteveMoody73 14y agoJust tried your code and it seems that my password has been cracked. Glad i changed it this morning now
- eidorianu 14y agoAny password that I try works...
- QWDEQWEQWE 14y ago<a href="http://www.bestwatchsale.net>replica http://www.bestwatchsale.net>replica watches</a> Watches Inc is known as the professional replica watches supplier, offer the high quality imitation watches from Rolex, Omega, Breitling,
- chli 14y agoIf your password was 'linkedinsucks' then it sucks because they found it already !
- jgrahamc 14y agoCorrect! 527688fa9f32bb8dab32d30807ca5c57a0b203b8 is not present 000008fa9f32bb8dab32d30807ca5c57a0b203b8 is present
- ciphergoth 14y agoHere's some they didn't find, from /usr/dict/words: Paraná, Zürich, attaché. Not sure of the encoding, but I'd guess UTF-8.
- DrCatbox 14y agoMy not so strong password is not in the list, spacex12, and Ive checked if it was already cracked by the prefix of 00000, nope.
- two1eight 14y agoAlso if it was "linkedin" 7728240c80b6bfd450849405e8500d6d207783b6 not present 0000040c80b6bfd450849405e8500d6d207783b6 present or "facebook" cbe648909034c0624c205fe219d3fbd10052c715 not present 000008909034c0624c205fe219d3fbd10052c715 present or google 759730a97e4373f3a0ee12805db065e3a4a649a5 not present 000000a97e4373f3a0ee12805db065e3a4a649a5 present
- madmaze 14y agoI disagree with #5, I had a few of my coworkers check their sha1 against the DB and most of them were not in the dump. I also checked for truncated hashed, none of which were found. I have the feeling this is a subset of the full database
- madmaze 14y agoon another note, my fairly complex alphanumeric+symbol password IS in the dump, though not prepended truncated with 0's and the other one I found, which my coworker admitted was too short and alpha only, was in the dump with prepended 0's. This could validate the fact that the truncated hashes are actually already cracked.
- nupark2 14y agoMine was 5 characters, alpha and numeric, but no special characters. It was in there, prepended with 0's. Whoops. At the very least, it should have been longer.
- tomh 14y agoSame here - mine was all alpha characters, seven characters, and the hash with five 0's was in the file. Guess who just changed their LinkedIn password today? And included some numbers?
- barik 14y agoI don't really see a purpose in hiding my password. So, as a counterpoint, my password is in the list. This is my LinkedIn password: AxEWS9rg5V This is the sha1: caf28fcc9c3e4d88b830b8e5cc52c5b65d3db5f4 It is found in Line 3612910 of combo_not.txt. I believe the file is authentic.
- ddlatham 14y agoAnother datum: the hash of my password (randomly generated 8 character mixed case alphanumeric) was in the file, without any overwritten 0's.
- 14y ago
- thaumaturgy 14y agoHmm. My truncated password (for my now-deleted account) is not in the list of hashes -- so it's not just a uniq'd full DB. Also, the original forum thread where the file was first posted only managed to break around 600,491 passwords before it went offline ... so 3,521,180 broken passwords could mean that the original hacker has had access to some LinkedIn accounts for more than just a few minutes today.
- iand 14y agoSame here. My password is not in the list and I've had a LinkedIn account since 2003. I probably changed my password about 18 months ago. Neither that nor the previous one are on the list.
- kylog 14y agoMy password is not in the list, not idiotic but not super-hard . I doubt this is the full list. I hadn't changed mine in years, so maybe this is from a certain period of time?
- OlavHN 14y agoI've had the same password on linkedin for as long as I remember and neither the full hash nor the zero prefix edited was found in the dump. Simple line used in OS X terminal: grep -e "`echo -n "your pass" | openssl sha1`" combo_not.txt
- jen_h 14y agoMay want to grab the last characters as the cracked passes have 00000 at the beginning: i=`echo -n 'mypass' |openssl sha1 |echo ${i:14}`; grep $i combo_not.txt This yielded success on some known passwords and a bunch of obvious passwords. Not mine, but I assume this dump is a list of the passwords they've cracked so far (i.e., even if your password isn't on this list - change it).
- riffraff 14y agofwiw, this could also be an elaborate hoax, given this facts. E.g. a list of simple password + combinations of the above simple password+"linkedin" variations.
- blantonl 14y agoI have a very unique strong password on LinkedIn, and it is on the list. Given that, this is no hoax.
- jaaron 14y agoSame here. Sucks too, because I liked that password.
- Yoms 14y agoMy complex unique password is also on this list (full hash no 5 0's). So nope, not a hoax. Unbelievable/insulting they didn't even bother to salt.
- jackalope 14y agoDo you remember when you first used this password at LinkedIn? It could help narrow the dates of the breach. Especially useful would be the presence of a strong password in the list that was subsequently changed. That might help determine its freshness, if the new password isn't present (although this may be an incomplete list from an ongoing breach).
- Yorn 14y agoI'm thinking this list is from closer to a year ago, I changed my password shortly after the MtGox hack last year and this hash is for my old password that was compromised during that time period.
- elektronaut 14y agoMy password is in the dump, and it was changed mid October 2010. I remember because I changed all my passwords when my laptop was stolen. The MtGox hack was in June 2011.
- shill 14y agoI have found hashes of linkedout, recruiter, recru1ter, googlerecruiter, toprecruiter, superrecruiter, humanresources and hiring. If it is a hoax, it is a very elaborate hoax.
- pbhjpbhj 14y agoPerhaps it's a DDoS on MediaFire! /joke
- shill 14y agoI have found one case where both types are present. grep `echo -n l1nked0ut | shasum | cut -c6-40` combo_not.txt 000000afef5f2ba94b104126d04db1837f423816 e7bf10afef5f2ba94b104126d04db1837f423816
- akkartik 14y agoHow many hashes are present in both stripped and unstripped form? $ cat combo_not.txt |cut -c7-40 |sort |dups |wc -l 670781 That's ~10% of the total.
- uselessuseof 14y agoanother useless use of cat cut -c7-40 combo_not.txt|sort|dups|wc -l what the heck is dups? cut -c7-40 combo_not.txt|sort|uniq -d|wc -l
- akkartik 14y agoYeah I'm aware of http://partmaps.org/era/unix/award.html#cat http://partmaps.org/era/unix/award.html#cat and choose to continue writing my scripts this way. My commands look more symmetric at the prompt, and are easier to manipulate. dups is indeed a little helper of mine. Like uniq it only handles sorted input. Update: I see you edited your answer to include uniq -d. I wasn't aware of the option, thanks. Now I can simplify the implementation of dups. But I find the name valuable, and I think it's perverse to say uniq when you mean its opposite.
- uselessuseof 14y agosymmetric?
- akkartik 14y agoEach pipe stage reads from the left and writes to the right. The eye goes left to see the input and right to see the output if it's redirected to file. The input file is reliably the second word, so C-A M-f gets me to it if I want to operate on a different file. !!:1 gets me the file if I want to use it in a new command.
- lt 14y agoAnother data point: I changed my linkedin password about three weeks ago. The old one is in the list (already 00000-ed), the new one isn't.
- rfugger 14y agoMy (very unique) password hash is in the list, although unbroken so far.
- andreyf 14y agoSorry for the stupid question, but where did you guys find the list of hashes? I didn't see it linked in the article. Edit: found it in the Slashdot comments, it's: http://www.mediafire.com/?n307hutksjstow3 http://www.mediafire.com/?n307hutksjstow3 For the record, my password's hash was not in the list.
- zer01 14y agoI think they're getting removed. I posted a link from the original source, but it's since disappeared.
- mehrshad 14y agoDon't know if this adds anything, but both my old password (created eight years ago) and current password (changed six months ago) were on the list. Both were very unique - 20 characters mixed. Need to get better at changing my PWs every three months. It's really not that hard, just a matter of discipline.
- nilsbunger 14y agoMy old password was in the list, but not my newer password. I changed it about 2 years ago I think.
- ghshephard 14y agoI don't know if I have the correct file: http://www.mediafire.com/?n307hutksjstow3 http://www.mediafire.com/?n307hutksjstow3 mbf041:Downloads shephard$ wc -l SHA1.txt 6143150 SHA1.txt My password hash which was last rotated July 5, 2011 .,7^R8Cl}g1}Ze6f Was _not_ found in the file (with/without 00000). I have, of course, changed it today. Strangely enough, the previous password is also not in the list.
- stordoff 14y agoMy password also doesn't appear to be in the list, so I doubt it is the complete/current file. I used this python to check, in case anyone else wants to use it: from hashlib import sha1 f = "combo_not.txt" hashes = [x[0:40] for x in open(f)] # [0:40] to stripe off \n # From another comment def check_pass(plaintext, offset=5): hashed = sha1(plaintext).hexdigest() return (hashed, '0' * offset + hashed[offset:]) print check_pass("linkedin")[0] in hashes # -> False print check_pass("linkedin")[1] in hashes # -> True (sanity check) myHash, myHashBroken = check_pass("plaintextoflinkedinpassword") print myHash in hashes # -> False print myHashBroken in hashes # -> False
- michh 14y ago> Evidence against that thesis is that password of one person that I've asked is not in the list. Mine isn't in it.
- bandris 14y agoNeither is mine.
- endtime 14y agoGood posted, upvoted. One clarification: > That's 25 users per hash Password choices are probably Zipf-distributed, so averages don't make a ton of sense.
- dredmorbius 14y agoIt does if you're trying to estimate the size of the corpus based on the number of users. The arithmetic mean is specifically the value you'd want. n users times m users/password == total passwords (unduplicated) in the LinkedIn database. Zipf distribution would suggest that the pattern of reuse among passwords isn't normal, and that the median and mode are probably higher than the arithmetic mean.
- joshz 14y agoMine was not in the list. It's also possible this isn't the entire file. I was also able to recover 225129 other passwords with a wordfile and some Python based on truncated and full hashes.
- perinteger 14y agoGot a link to the file? I haven't been able to dig one up
- Estragon 14y agoSo where is the list? I'd like to see whether I'm on it.
- royce 14y agoA stock JtR 1.7.9-jumbo5, using the default rules, is finding quite a few of the non-zeroed ones pretty quickly. This surprises me; I would have expected them to have run the list through the JtR mill before passing it on to others.
- diminoten 14y agoThe list of cracked hashes is almost certainly not complete, one can conclude from this fact.
- pruby 14y agoThe hash of my password, set when I joined on October 10 2011, appears not to be in the list. Changed it anyway.
- A1kmm 14y agoLikewise, my password (MybXy836YCza), which wasn't used anywhere except my LinkedIn account created 29-Jan-2012, and has been stored securely at my end, wasn't on the list (either as a full SHA1 sum, or as part of the SHA1). As you probably guessed from the fact that I posted my old password, I changed it just in case the list that was shared is only a partial list of what was obtained.
- pythonophilic 14y agoNice observation dude, Can u please share the password file I dont have it anywhere. Thanks
- pythonophilic 14y agoNice observation dude, Can u please share the password file I dont have it anywhere. Thanks
- QWDEQWEQWE 14y ago<a href="http://www.bestwatchsale.net>replica http://www.bestwatchsale.net>replica watches</a> Watches Inc is known as the professional replica watches supplier, offer the high quality imitation watches from Rolex, Omega, Breitling,