20 ms·
Linode hacked, CCs and passwords leaked
- krakensden 14y agoA link to an unapproved /. submission. Fascinating choice.
- gee_totes 14y agoIs there any confirmation on this? [edit] Just looked at twitter, this tweet doesn't look good: https://twitter.com/Jamiesingleton/status/322730588459114500 https://twitter.com/Jamiesingleton/status/322730588459114500 But it may just be random coincidence. [edit again] Links from slashdot article: IRC chat: http://turtle.dereferenced.org/~nenolod/linode/linode-abridged.txt http://turtle.dereferenced.org/~nenolod/linode/linode-abridg... Link in IRC chat (i think it is of linode.com's web directory): https://bin.defuse.ca/hq0Ay8RzpKdR6vQwYxnmhc https://bin.defuse.ca/hq0Ay8RzpKdR6vQwYxnmhc
- firemanx 14y agoThat tweet would suggest to me that someone's credit card was stolen via another method and used to purchase Linode services, rather than the other way around. Ie, I don't think that was related to Linode breach.
- smtddr 14y agoPutting aside any opinions on his morals or maturity-level displayed in the chat, it's a fun read. I love how ryan keeps reconnecting after each attempt to kick him out. He must have a pre-verified list of proxies/compromised-boxes he can connect from so he's just burning through them as he gets banned. I found that amusing.
- nwh 14y agoThere's URLs in the leak that could never have been guessed, like http://www.linode.com/y_key_57284cb2de704e02.html http://www.linode.com/y_key_57284cb2de704e02.html (mentioned by Tomdarkness above).
- ConceitedCode 14y agoI guess this is why they wanted everyone to reset their password 2 days ago. https://news.ycombinator.com/item?id=5541915 https://news.ycombinator.com/item?id=5541915
- nivla 14y agoNot sure how useful that reset was. All I had to do was type in my old password and then choose a new one. No email verification, no reset token, nothing. So if the password was indeed compromised, couldn't the attacker do the same?
- ceejayoz 14y agoIt addresses the "attacker has a list of hashes that'll take him a while to compute matches for" aspect of things.
- marcosdumay 14y agoYes, he could. But he didn't. If he did that, the page would tell you that your password is wrong, and you'd contact support. The attacker probably didn't change any password, because it would be futile. Also, the attaker could also change the account email. Neither tokens nor email confirmation would help. The biggest problem is for people that used the same password on Linode and any other important service. (And, of course, all the CC stuff...)
- Macuyiko 14y agoNot only that, it also makes me wonder about the free RAM upgrade from almost a week ago. Some people are reporting their Linode credit cards being used for fraudulent purchases as far as a week ago, so this might have been a move to gain some pre-emptive goodwill. I don't know though... will wait until more details are available but will be keeping an eye on CC statements / VPS alternatives.
- ConceitedCode 14y agoI tend to think the timing is just a coincidence. They also upgraded CPU and bandwidth over the last month and there were rumors of upgraded RAM for a while too.
- danso 14y agoFrom a purported abridged chatlog with the alleged hacker: > 05:42 < ryan||> credit cards were encrypted, sadly both the private and public keys were stored on the webserver so that provides 0 additional security > 06:00 < ryann> They did try to encrypt them, but using public key encryption doesn't work if you have the public and private key in the same directory http://turtle.dereferenced.org/~nenolod/linode/linode-abridged.txt http://turtle.dereferenced.org/~nenolod/linode/linode-abridg...
- deleted 14y ago[deleted]
- jlgreco 14y agoWouldn't doing that be a massive PCI violation? Aren't there extensive audits for this sort of thing?
- tptacek 14y agoExtensive PCI audits. Heh.
- jimktrains2 14y agoLike the "scan" that said our linux boxes were running an out-of-date version of IIS.
- psychometry 14y agoThat compliance web form I absentmindedly clicked through sure had a lot of buttons.
- larrys 14y agoCan't think of the exact word to describe that practice (what you did in response to the long list of questions which I've seen) but on the part of the company requesting you to answer the questions it's more or less a "absence of malice" type of thing that allows them to appear that they are doing the right thing while fully knowing that people are doing what you are doing. It's a "we will look the other way until we need to show that it's not our fault because we have passed the liability to you - look you acknowledge doing all the right things".
- Tomdarkness 14y agoFound it interesting that Linode uses Coldfusion. Wonder if Adobe has anything to say about the apparent 0-day. If the hacker's claims are true (Would appear so, the directory listing checks out) then Linode really need to address this ASAP. Passwords are one thing but to have CC details leaked is even worse. I'm not familiar with CC processing but it seems like bad practice to store the encryption keys on the web server.
- tptacek 14y agoIt wouldn't take a zero-day flaw in the Coldfusion stack for a CF application to have an undocumented vulnerability; in fact, it's much more likely that the vulnerability is in the application code than in the stack itself.
- Tomdarkness 14y agoThe hacker claims it to be a CF 0-day vulnerability: > 05:05 < ryan_> manager.linode.com was breached with a coldfusion exploit ... > 05:33 < Ruchira> ryan||: give us the link to cold fusion vulnerability that you are talking about > 05:34 < ryan||> Ruchira: 0day > 05:34 < ryan||> linode staff apparently failed to deduce it themselves and relied on chmodding CFIDE to 000
- tptacek 14y agoDepending on who you're talking to, an app-level vulnerability in a Linode management console might be called a "0-day". But it's true that a CF stack flaw is not impossible.
- 127001brewer 14y ago"... CF stack flaw is very possible and almost always likely ..." There, I fixed it for you. Working with ColdFusion is like this: http://25.media.tumblr.com/38d67be62da60b4d3aa1d0ac22e4e314/tumblr_mj9bp0LoLC1r3k73wo1_400.gif http://25.media.tumblr.com/38d67be62da60b4d3aa1d0ac22e4e314/...
- citricsquid 14y agoMy Visa card that I used with Linode was stolen and used on an Amazon order I didn't authorise last week, my bank successfully blocked the charge. Someone else reported their Visa had also been compromised in the thread 2 days ago, looks like that confirms the suspicions: https://news.ycombinator.com/item?id=5542015 https://news.ycombinator.com/item?id=5542015 Poor show Linode. (edit: worth noting I use the card with other things too, I have no confirmation it was leaked through Linode other than the compromise happening at the same time these supposed leaks happened).
- austengary 14y agoSwitched to https://www.digitalocean.com/ https://www.digitalocean.com/ last week. Excellent service and pricing.
- Kudos 14y agoYeah, a week sounds like plenty of time to assess a hosting provider.
- austengary 14y agoOh, and the years of Linode assessment were adequate?
- umsm 14y agoEvery site can be hacked. It's just a matter of time. You just have to properly react: call your CC provider, check for any charges on your bill, and move on.
- austengary 14y agoI do not think anyone here is actually worried about their funds; as mentioned below, any reputable provider will have such charges promptly reversed. The problem is instead with their response to the situation. Linode has addressed the breach, but assured customers nothing of value had been compromised. This infers two thoughts. One: they knew of the breach and lied, thereby unveiling a unforthcoming and dishonest nature. Or two: they did not properly investigative the severity of the issue, thereby suggesting incompetence. Both equally reprehensible.
- deleted 14y ago[deleted]
- ConceitedCode 14y agoIf this is true then all the trust that Linode has built up over the years was just thrown out the window. According to the hacker they've known for 2 weeks and made a deal with the hackers. Ultimately, they were as far from transparent as it gets and on top of that they did a horrible job with their security. Hopefully, they own up and start being transparent. If this is true then what alternative hosts should I look at, besides AWS?
- pibefision 14y agoDon't be so logical please. This can happend to anyone in the industry.
- ConceitedCode 14y ago"credit cards were encrypted, sadly both the private and public keys were stored on the webserver so that provides 0 additional security" That's just poor security and 100% they're own fault. I accept that there are security issues with every platform, but basic security measures and being transparent is still expected. My biggest issue with them in all of this is not being transparent.
- dubcanada 14y agoWhat are they supppose to say? Looks like someone who likes attention on some random IRC channel who is apparently a hacker may have hacked our system and we don't know who/when/where/why/how or what they may have got. Nor are we sure we were even hacked??? It takes time for people to investigate stuff. It's not just a couple hours. Also some random guys words on IRC (who could very well own INSERT RANDOM HOSTING COMPANY for all we know and looking to scare people off Linode) should be taken with a grain of salt.
- rscale 14y agoThey could say "We have hired matasano security to help us investigate the breach."
- thehermit 14y agoThe chatlog does provide some evidence that it is indeed the hacker, but does little to convince me that he got CC info and Linode is not telling us the whole truth. The evidence he provides is just simple source code snips and the directory listing, which would be expected based on what Linode has told us. This could very well be the hackers own submission to /. trying to get more attention for his hack by claiming he has CC numbers which I doubt he has.
- jdhore 14y agoI know the /. submitter (As he's the one who told me he submitted it to /. and he had the first /. link I saw), he's definitely NOT the hacker.
- lawnchair_larry 14y agoDoubting the claims of a hacker after it's known that they compromised a system is really bad OpSec. Consider everything burned.
- thehermit 14y agoThat's a fair point. I'm speaking more as a judge/jury view on the situation though. I don't think Linode users should panic and run for the hills just yet based off this alone.
- nenolod 14y agoExcept Linode didn't tell us that. Linode said it was a downstream customer's info that was compromised. Nothing about Linode itself.
- lawnchair_larry 14y agoWell I'll wait for a response from linode, but it certainly looks like they were very dishonest. I think I will close my account.
- hosay123 14y agoSo you're unfortunate enough to be a customer who had their CC leaked. So you spend 5 minutes changing your password (you use unique, non-formulaic passwords, right?) and 15 minutes on the phone to CC company to ask for a new card. Then you use your backup card for 2 weeks (you have a backup card, right?) A month later, spend 30 minutes on the phone with CC company only if strange transactions appeared. Not the end of the world. The CC industry is set up well to handle this kind of thing.
- icey 14y agoYou missed the step where you have to find all charges going to your old CC and then deal with moving every one of those accounts to your new one when it gets there. Hopefully you don't incur any late fees while you're going through the process! Kind of sucks to have to spend hours doing that for someone else's oversight. It's not the end of the world, but it paints a clear picture about where a company's priorities are.
- hosay123 14y agoMaybe I'm weird, but I know exactly which binding credit agreements I'm in and how they're paid, and definitely none of them get paid using another binding credit agreement. :)
- jlgreco 14y agoI mean, I know all that I'm in, but I can definitely see myself missing one or two if asked on the spot to recall all of them. Phone, cable, AWS, gym, power, garbage/etc, insurance,... I'm sure there are one or two others. Even if there aren't, I'd feel compelled to go through everything to make sure there aren't more. Even just dealing with all of those is going to be a pain in the ass though. I'd probably end up spending hours all together just on hold with some of those people. Edit: Netflix. I forgot Netflix.
- pibefision 14y agoI had a VPS on linode. I think that Linode did a big mistake here. Let's wait for a formal communication. But this is the moment to support them. Yes, maybe sounds crazy. When you host on any third party datacenter, you take risks that something like this could happen. So, deal with it. Check your credit card, if your receive something wrong, call to your card and that's all. But we need to support also the good work, and this guys do great work in the hosting business. Just my opinion.
- ceejayoz 14y agoIf this is true, they've blatantly lied thus far in their communications with their customers. I don't think that deserves support.
- eridius 14y agoWell said. It's a fact of life that companies get hacked. So it's no surprise that it eventually happened to Linode. If you flee somewhere else, all you're doing is hoping that the other company you run to won't get hacked rather than using any logical thought. I can think of two good reasons why you should flee Linode. It remains to be seen if either are actually true, and until indications say yes, then panic is unwarranted: 1. If it becomes apparent that Linode is far more vulnerable to hacking than other hosting providers. But one hack alone does not prove this. 2. If Linode grossly mishandles the situation. There have been a couple of allegations to that effect so far, but nothing substantial. I don't see any reason to claim that they've done this yet.
- tomjen3 14y agoLinode has already grossly mishandled the situation by not coming out with a complete statement about what exactly happened. I only read this news because it was posed here -- no email notification, no update on their homepage, no twitter, no nothing. The alleged hacker has made serious and specific claims, and Linode has done jack shit; without more information, how should I proceed? I don't want to call my bank and waste time getting a new credit card (not to mention replacing a million and two services) without a confirmation and I can't get a confirmation because Linodes people are having a circle jerk (or whatever the hell they do).
- akennberg 14y agoLove the whole side discussion about bitcoin from the supposed attacker: 06:07 < ryannn> They say there's no 'central weak point' 06:07 < ryannn> Yeah there is, there's the developers 06:08 < ryannn> There's been bugs in the client that have allowed the blockchain to split previously 06:08 < ryannn> One could just backdoor the bitcoin client binaries, not the source. 06:08 < ryannn> Nobody would figure it out until it's too late http://turtle.dereferenced.org/~nenolod/linode/linode-abridged.txt http://turtle.dereferenced.org/~nenolod/linode/linode-abridg...
- drivebyacct2 14y agoI'm curious how he's going to backdoor the binaries running on my computer built by the launchpad servers without anyone noticing. Granted, I'm not checking the commit logs every time apt gives me a new version, but all the same.
- api 14y agoThat explains why my LLC's business debit card was turned off due to a fraud alert.
- sergiotapia 14y agoSo what happens now to all the goodwill Linode has amassed through the years? Does it all turn to shite, almost overnight? This sounds very very bad, and as a customer it's very off-putting.
- stefantalpalaru 14y agoThat's pretty much how trust works.
- xr09 14y agoI'd give another trust vote to Linode, anyway this could happen to anyone.
- obituary_latte 14y agoThat's true -- it could indeed happen to anyone who keeps encrypted data adjacent to the keys.
- kyrra 14y agoLinode really needs to make a statement about what happened with this hack, stating if credit card information was taken. A lack of communication does not help me trust them. I'd rather have them speak up as to what happened and know if I need to have my CC reissued.
- kalleboo 14y agoThey may not know if CC info was taken or not.
- inetsee 14y agoIt seems to me that the fundamental problem is not that they got hacked (although it seems that storing a decryption key in the same directory as the encrypted data is over the top careless), but their response to the disclosure that they got hacked. I realize that there may be limitations on exactly what they can say, but they should be as open as possible on what may have happened, what they are doing to protect their customers, and what their customers should do to protect themselves. Customers taking action when there wasn't a breach is less of a problem than not taking action when there was, in fact, a breach.
- tomjen3 14y agoTo those of you who have claimed that your CCs have been abused -- I checked mine (which I used to pay for Linode) and it hasn't been used to do anything funny.
- regularfry 14y agoyet.
- kansface 14y agoI checked mine and nothing untoward has taken place. All the same, I put it on hold. Everyone should assume their CC is compromised.
- tomjen3 14y agoWhy? It is a major waste of time to insert it into all the places that I have used it and should it be abused, then I just dispute the charges.
- VMG 14y ago(not knowing anything) - wouldn't it be possible to give the cc company a white list of clients that can continue to use it and block all other requests?
- perlgeek 14y agoReally off-topic, but still sad: This is a link to slashdot, but it's on HN's frontpage before it's on slashdot's front-page (if it'll ever get there). (And IMHO that's sad, because /. used to be top notch). I've noticed before that stuff from the HN frontpage appears on /. one to three days after, but I've never seen it for links to slashdot :-)
- pc86 14y agoI've noticed the same thing for almost every tech-related subreddit, especially /r/startups and /r/programming. A consistent 2-3 day lag.
- Zancarius 14y agoI rather wish this was a link instead to the original thread rather than to Slashdot. It isn't a big deal, but it certainly would have saved an extra click. Also off-topic: I've noticed that as well with Slashdot, which is why I lurk HN pretty regularly now. Plus, some of the front page material on /. does more to insight angry discussion, and the community has become increasingly more vitriolic. At least here, even if someone's brash, they're fairly honest about it (in general). I've even seen a number of disagreements that have been respectful and cordial. It's sad to say, but that's a rare thing these days.
- whalesalad 14y agoI'm looking forward to seeing an official response from Linode on this. Hopefully they are fast and honest about it. I've been a happy customer for quite a while, but this is definitely a concern.
- UnoriginalGuy 14y agoThey weren't exactly fast and honest the last time a break-in happened. In fact even to this day nobody is quite sure what went down aside from tons of Bitcoins going missing!
- adamtulinius 14y agoThey are already way overdue. Their support staff is pretty damn fast, so I'm sure they could have commented on this if they wanted to. Alas, they have not. I just blocked my credit card, and Linode will not get anymore of my money. Too bad, i enjoyed my stay very much, but no matter what their response will be, I doubt I will be able to believe them. =/
- seany 14y agoYou think linode is going to be transparent about things?
- jimktrains2 14y agoWhy would you store credit card numbers? Almost every processor has some method to store them with the processor and all you need is a token.
- plusbryan 14y agoWhen was this alleged hack supposed to have happened?
- xhrpost 14y agoOff topic but still relevant, but doesn't it seem a bit primitive that companies have to store you CC# for recurring payments? The one number that uniquely identifies your account and everyone you want to re-use it has to keep a copy. Couldn't the credit card company issue some unique ID to each vendor for recurrent payments? Ex. the vendor issues your CC# to the CC Company for charge and recurring process. The CC Co. responds by replying back with authorization and an ID unique to that vendor that says "Use this number for charging this customer again, but it will only work coming from you, so if you lose it, it can't be used elsewhere". The vendor then discards your real CC number.
- xaro 14y agoThat's what Stripe do.
- drbawb 14y agoBut isn't that just between Stripe and the company requesting payment? e.g: Acme, Inc. sends Stripe your CC#, Stripe sends them some unique token, and they store that; correct? So Stripe still has your CC#, and is at risk. So this is really just risk mitigation; what I think TP is suggesting we need is unique authorizations at the banking level. Something on the order of virtual credit cards, or temporary tokens, which are ultimately verified by your bank [or in other words: the lender(s) making anti-fraud guarantees, etc.] (e.g: this token is authorized for 24 hours up to this limit; this token is authorized indefinitely up to $xx/mo.; this token is authorized for 1 year; etc.)
- ams6110 14y agoNo. Customer sends Stripe their CC number, via AJAX in the browser. Acme, Inc. never has it even transiently. Stripe return a token to the browser, which is sent in a POST to Acme, Inc., then they verify it server side with a private API key. Edit: yes Stripe has your number, but since their sole business is about securing that information, they probably do a better job of it than your typical online merchant.
- 14y ago
- tlrobinson 14y agoHmmm, Linode claims they emailed their customers about the password reset, but I never got an email (nor in my spam folder)
- tbrownaw 14y agoI got one, so there were at least some of those emails sent out...
- buro9 14y agoSaturday morning: From: "Linode" <support@linode.com> Date: Sat, 13 Apr 2013 00:11:09 -0000 Precedence: bulk Return-Path: 6723614.1706014@e2ma.net Message-ID: <knuab.c9dae.xxx@e2ma.net> List-Unsubscribe: <http://e2.ma/optout/c9dae/xxx> X-Test-Mailing: no Dear Linode customer, Linode administrators have discovered and blocked suspicious activity on th= e Linode network.=C2=A0 This activity appears to have been a coordinated at= tempt to access the account of one of our customers.=C2=A0 This customer is= aware of this activity and we have determined its extent and impact.=C2=A0= We have found no evidence that any Linode data of any other customer was a= ccessed.=C2=A0 In addition, we have found no evidence that payment informat= ion of any customer was accessed. We have been advised that law enforcement officials are aware of the intrus= ion into this customer=E2=80=99s systems. We have implemented all appropria= te measures to provide the maximum amount of protection to our customers. O= ut of an abundance of caution, however, we have decided to implement a Lino= de Manager password reset. In so doing, we have immediately expired all cur= rent passwords. You will be prompted to create a new password the next time= that you log into the Linode Manager. We also recommend changing your LISH= passwords and, if applicable, regenerating your API key. The following represent best practices in creating new passwords: -- Avoid using simple passwords based on dictionary words -- Never use the same password on multiple sites or services -- Never click on 'reset password' requests in unsolicited emails - instead= go directly to the service We apologize for the inconvenience. If you have any questions, please do no= t hesitate to contact our support team at support@linode.com.
- bifrost 14y agoWelcome to GMAIL?
- AlexMuir 14y agoAh this is so shit. I want to support Linode, I've had nothing but a good experience. But I just had to check my credit card to be sure they hadn't lost my details. I've NEVER had to do that before with anyone - they've got to respond fast here because if I don't trust them with my CC then I can't leave five-figure contracts at jeopardy hosted on their servers. I've been living comfortably on Linode servers for over three years. This is like suddenly being evicted and having to pack my stuff up and find another apartment. I have to wait for some sort of verification for this but if true then I have to leave Linode. I have client sites hosted here - not for cost reasons, just because I like Linode. For the sake of $5 a month I can't even take the slightest risk of being criticised for using Linode. And this lack of transparency could be a nail in the coffin here. I don't want to waste a couple of days on this but that's what's going to be involved if this is true.
- thenomad 14y agoQuite. I like the company and their servers are good - but we need a detailed response, and we need one now.
- kyrra 14y agoI'd say support tickets or posting on their forum[1] may help try to get a response. But based one one of the support ticket responses posted in the comments in this HN story already, it sounds like Linode isn't allowed to release that kind of information yet. They may be waiting on the police and/or their lawyers to allow them to talk publicly about it. And if that isn't the gating factor, they are probably trying to determine what they are required and should share about the incident. [1] http://forum.linode.com/viewtopic.php?f=20&t=9978 http://forum.linode.com/viewtopic.php?f=20&t=9978
- chintan 14y agoits a recursion! the forum points back to here
- 14y ago
- segmondy 14y agoIs this why Linode doubled the RAM? To bribe us and make us stay. I'm pretty pissed off about this and will be exploring other options. I'm not pissed off they got hacked, I'm pissed off they are hiding and not being forth coming about it. A simple, "We fucked up, we are going to take steps 1, 2 3 to fix it and reduce the likely hood of this ever happening again" will make me happy. I understand that any server can be hacked. I'm stunned that they are storing CC details on the servers, there are ways to go about this without storing them if you want recurring billing.
- eridius 14y agoI'm stunned that you, and plenty of other people in this thread, are taking the anonymous IRC person's word as the gospel truth.
- cwb71 14y agoI am not sure that "gospel truth" is a fair characterization. Anonymous IRC person has provided verifiable details that strongly suggest he or she had access to Linode administrative systems. Fyodor's post to nmap-dev supports the notion that customer nodes were accessed as well. Linode has provided no details or evidence of anything. I don't think one has to take that IRC log as gospel truth to be reasonably concerned about the security of their data stored by Linode.
- eridius 14y agoThe only "verifiable detail" I saw in the chatlog was the output of `ls` in the http root. And that's only verifiable because you can try to access that weirdly-named HTML file and get a 200 back. Honestly, that doesn't tell me a whole lot. Everything else, such as the password hashes, don't seem at all verifiable (even if someone were to crack any of the hashes, you can't verify that the password worked at the time of the hack because Linode has presumably changed them all anyway).
- gklein 14y agoThat may explains the seclist hack too... http://seclists.org/nmap-dev/2013/q2/3 http://seclists.org/nmap-dev/2013/q2/3
- l0c0b0x 14y agoHoly cow!.
- Zancarius 14y agoIf that's the same one, then that link implies Linode already fixed the issue on or around the 13th. So, I'm wondering if the silence that has some folks here up in arms is indeed because they've been instructed by law enforcement to keep quiet pending the investigation. Now if we could only stay the torches and pitchforks for a while before this gets sorted out...
- stefantalpalaru 14y agoA funny comment on IRC: "One bit of good news from all this hubbaloo: more space will be opened on the new E5 hosts from customers leaving \o/"
- kaolinite 14y agoJust rang my bank to cancel my debit card. Hate doing that. Now I have a week or two of failing payments, bills, etc to look forward to. I will probably be moving away from Linode after this. The poor response to this and lack of full disclosure, plus reading that they're using ColdFusion (wtf?), means I don't feel I'll be able to trust them any longer. It's a shame because their UI and service is generally fantastic.
- eddieroger 14y agoThere's nothing wrong with ColdFusion, especially if you've had it around for a while. It's not as glitzy as Rails, but it works and it's still supported and modern. Besides, this isn't ColdFusion's fault. Leave because Linode violated your trust, but not because of the programming language they wrote their site in.
- kaolinite 14y agoIt's closed-source, made by Adobe and seems to have a bad security record - there are 3 things wrong with it. Besides, it's not the reason I'm leaving - it just makes me question them. I'm not after glitzy. If anything, I'd have expected Linode to have been written in Perl or something.
- caf 14y ago(made by Adobe) ⇒ (closed-source) ∧ (has a bad security record)
- spangborn 14y agoThe problem more lies with Linode not properly dealing with a disclosed ColdFusion vulnerability: http://breenmachine.blogspot.com/2013/03/cool-coldfusion-post-exploitation.html http://breenmachine.blogspot.com/2013/03/cool-coldfusion-pos...
- oinksoft 14y agoIt may not have been disclosed yet when it was exploited.
- neya 14y agoI am an ex-customer of Linode and I'm still worried about this incident - Do they still store your card after you've quit the service? This is terrible :(
- moondowner 14y agoI'm in the same situation...
- minib 14y agoI've asked them this question. Here is the answer: Credit card information continues to be stored in our database in an encrypted format, and the decryption key is not stored electronically. We are working on a process on remove the credit card details of past customers on request and can handle this for you soon if you would like. If you have any further questions or concerns please let us know.
- neya 14y agoThank you :)
- run4yourlives 14y agoSo the answer really doesn't answer the question. (It appears the answer is no, but given they haven't been forthright in the actual details of the hack, possibly not)
- benmw333 14y agoI just requested a new CC. Can never be too safe. Not sure I'm going to stick with Linode now... sucks because they seemed to be doing so many things right.
- wesray 14y agoI have the same sentiments, new cc and might move off linode, who I have been with for 4 years.
- adrianwaj 14y agoI wonder if they've deleted CC details of previous clients. Is Linode going to contact all relevant customers? Seems like the right thing to do. Not everyone reads HN.
- regis 14y agoI was just told by a customer service rep at linode that I "shouldn't trust everything I read on the internet" when I inquired about the possibility of deleting my personal information from their server. This seems like an extremely inappropriate way to handle this situation...
- adrianwaj 14y agoBy the sounds of it, they probably don't know the full extent of who and what was taken, otherwise they could just email everyone involved and say: "there's been a breach and it affects you" ... or they could contact CC companies.
- dfbrown 14y agoI stopped using linode in mid February and I have not received an email. They also still appear to have my credit card attached to my account (and I had to change my password when I logged in).
- bzalasky 14y agoSo glad the CC I had on file expired this month. +1 for procrastination. Here's to hoping Linode gets their shit together.
- wildmXranat 14y agothe card with my linode account has a minimal amount total allowed to charge. I'll go through my cc usage, but at worst they could've gotten a couple of ebooks. as a long time customer though, Im conflicted and motivated to move off linode to another provider.
- carbocation 14y agoJust like I can have application-specific passwords for my Google account, I wish I could have application-specific credit card numbers from my CC issuer. If I had these, I would immediately cancel my Linode-specific CC# and reissue a new one. I would not have to worry that my other recurring bills will go unpaid, or spend hours dealing with tracking them down and changing them.
- jaredsohn 14y ago>I wish I could have application-specific credit card numbers from my CC issuer Do some research on "virtual account numbers". I haven't used them myself, so I can't verify how well they work.
- treahauet 14y agoEither this, or a assignable CVV codes. Something like that would be awesome.
- dangrossman 14y agoThat wouldn't work since CVV codes aren't sent with recurring transactions (they can't, since they cannot be stored).
- jimktrains2 14y ago__should__ not be stored
- treahauet 14y agoGood point. Regardless, there should be __something__.
- gcr 14y agoWhy can't they be stored? Is it a legal requirement to prevent merchants without the CCV from using the credit card? ...oh wait
- 14y ago
- agwa 14y agoFYI, I just learned from Linode support that accounts have both a default LISH password AND a default API key, which means that even if you've never set a LISH password or generated an API key before, you still should still go and reset them. This is not what I would consider expected or desirable behavior.
- nenolod 14y agoHacker News, wherein I find further motivation to immediately get my off-site services off of Linode...
- eevee 14y agoI've never generated an API key, and Linode showed it as blank. I generated a new one anyway, but I can't imagine how they'd have a default key and somehow not show it in the UI.
- agwa 14y agoI know. I've asked for further clarification, especially since their email on Friday said API keys should be reset "if applicable." Edit: Groan, here's their clarification. It's starting to look like they don't know what the heck they're talking about: "Thanks for getting back to us. To be extra cautious it would not hurt to regenerate your Linode API key. You can do that in your user profile. Please let us know if you have any other concerns we can address."
- dhess 14y agoAfter seeing your original post here, I also asked for clarification, and received a similar reply from support: The Lish password is set to a random string by default, however we would still recommend resetting this password even if you had not set one manually previously. I had expected that if the password was not set, then password auth was disabled. I've told them that's what I want and have asked when it will be implemented.
- 14y ago
- jervisfm 14y agoDoes any one know of other VPS providers who are about as good as Linode in terms of quality and price but do not have a history of security issues ?
- muloka 14y agoFortunately my CC information on file is expired.
- EwanToo 14y agoIs there another way of learning the URLs like http://linode.com/googledebcc14d3c9f777a.html http://linode.com/googledebcc14d3c9f777a.html and http://linode.com/y_key_57284cb2de704e02.html http://linode.com/y_key_57284cb2de704e02.html If not, it seems likely that he did have read access to the main website filesystem at least
- bradleyland 14y agoI'm most concerned about Lish access. I'm not liable for fraudulent charges to my CC, so all I'll suffer is inconvenience. I'm most concerned about access to my VMs, which can be a business terminating event if things go extremely badly.
- tmslnz 14y agoSo, they asked us to change the password for reasons they cannot yet tell. The fact that they cannot lay it all out for our curiosity is driving most of people here off the rails. I don't have any problem with letting them verify & deal with the issue properly before releasing any public statement. Anyone who's ever been with them has never received less than perfect customer service. Can we give them a break, wait and hold our judging wands for a moment? It's not like they are staying mum out of spite towards their customers and the press…
- oliwarner 14y agoI echo everything everybody has said. This sucks because we don't know one way or the other. This may be some asshat FUDing away, or this may be a genuine hack. It's hard to get angry at anybody but Linode needs better auditing around sensitive data so they can tell people one way or the other. I resigned to the fact that I'd find it easier to change my card details in 30-odd online shops than it is fight my bank to get my money back. Now I can't make any purchases for 7-10 days.
- ebtalley 14y agoJust got a response from linode: somethings not adding up? ---------------------- dportalatin 30 minutes ago Hello, Thanks for getting into contact with us about this. Linode has found no evidence that payment information of any customer was accessed. We have implemented all appropriate measures to provide the maximum amount of protection to our customers. If you have any other concerns we can address, please let us know. Regards, Dolores
- jyap 14y agoRemember when the Linode customer service portal was compromised which exposed everyone's VPS?: http://julianyap.com/2012/03/01/compromised-linode-vps.html http://julianyap.com/2012/03/01/compromised-linode-vps.html In that case, specific Bitcoin users were targeted. It's pretty much why I don't trust Linode. You can't trust a company which puts random AMI BIOS files on the main index directory on the main web site. You can't trust a company that can't even lock down their own Linode customer service portal (which could lead to a breach of each and every customer's VPS). Perhaps history is fuzzy for people when new announcements come out or low prices are around.
- ercu 14y agothis is why i always use my "virtual credit card" on web sites that store CCs.
- robomartin 14y agoHow about you guys cool it and stop organizing a lynching mob devoid of any real data? It's embarrassing. HN is supposed to be populated with lots of very smart, data-driven analytical folks. Yet, every time something like this happens out of the woodwork come people who would ran you and your children down in the event of an emergency rather than turn around, carefully evaluate the situation, and help you. Don't be a moron. Stop it. For all you know there's a serious law enforcement effort under way that prevents Linode from talking. For the record, I am a Linode customer and just got a new server to migrate a couple of sites into. My plans have not been altered at all by this. I have no data to suggest I should.
- anon808 14y agoMob-mentality. Unfortunately naturally occurs whenever a group gets to be about the size of a mob.
- jeremyjh 14y agoI don't think that quite explains it. Someone who calls himself "ryan" on IRC makes unsubstantiated claims, and in response many dozens of people say loathsome, sneering things about the security practices of this company. The appearance of a mob emerges after a thread exists, it doesn't create the thread.
- jrgnsd 14y agoThe IQ of a Mob = (The lowest IQ in the Mob) / (The size of the Mob) This from a Terry Pratchett book. Can't remember which one, but it's one of the earlier Discworld books.
- shubb 14y agoReading through the IRC chat log it didn't look like he'd proved he had the CC numbers. I mean, if I was a linode customer I'd definitely be on the phone to the bank, but this guy presented no evidence I'm aware of that he had the kind of access he claims.
- taligent 14y agoThis is the SECOND time this has happened. And on both occasions no information was given to customers about what happened, what was fixed and whether it would happen again. The only moron here is you for NOT assuming the worst with a company with a track record as poor as Linodes.
- spydum 14y agoI don't know the skill level of the Linode folks, but could it be that they left a honey-pot CC DB out for this hacker to discover on purpose? Keys sitting right there?
- etjossem 14y agoThe best part is at the very bottom of the log. A customer enters the IRC channel to ask for support after ryann (the hacker) finishes explaining the attack. Customer: "hello, i forgot my password and linode's email reminder service doesn't work. i checked spam box but there's no email from linode." Linode Guy: "ryannn: can you give him the password?"
- jcoder 14y agoWell, here's a data point: https://news.ycombinator.com/item?id=5554071 https://news.ycombinator.com/item?id=5554071 Since Linode has proven in the past that they aren't the worst at communication, I can only assume some entity really has them over a barrel, considering the curt and callous responses there.
- callahad 14y agoNo suspicious charges on my end, yet, but I did just find out that my bank (USAA) is finally offering cards with Chip-and-Pin, which causes the card number to get re-provisioned. No time like the present, eh?
- brandon272 14y agoIs it just me or is each passing minute without an acknowledgment of this issue bad for Linode? There's tens of thousands of customers right now who would kind of like to know if they need to request new credit cards or not, or don't know about this and deserve to know that their VPS provider's credit card database has been compromised.
- epo 14y agoWhen did this breach occur? The implication is that it was a couple of weeks ago. As it happens my CC expired at the end of March.
- nazka 14y agoAgain! I seriously start to lose trust in the startups' security of the Silicon Valley...
- u2328 14y agoThey're based out of New Jersey, actually.
- level09 14y agoI'm just curious, is this in any how, related to the recent RAM increase ?
- ZaneA 14y agoDoesn't look like it. If you believe the IRC logs, the attacker broke in using a "0day" exploit of ColdFusion, which is being used on the site. Not because of a flaw in RAM upgrades. Although I believe that Linode beginning to offer free trial accounts is probably responsible for the increase in attacks lately...
- dkd903 14y agoI Got this response: "Hello, Your credit card / financial institution should have a mechanism in place that protects you from occurrences of fraud. While we have found no evidence that payment information of any customer was accessed, you're welcome to reach out to your financial institution for clarification on this policy for personal assurance. This is still an ongoing investigation and in the event that any additional information fruitions which negates our preliminary investigations, we'll be sure to advise customers accordingly." I feel this is arrogant
- jkeesh 14y agoI recently sent an email to linode support, and got a very murky response. I used my debit card on linode, and it was recently used on transactions I didn't make in random parts of the world that I'm not in, so I had to cancel it. My first guess was that it was linode, and all of the posts here make it more likely. Essentially: I am a linode customer. My cc details were somehow leaked. Adds a data point here.
- DigitalSea 14y agoAs someone who has been a very happy and loyal Linode customer for a long time now, this whole situation paints an image of Linode I otherwise would never have thought. The fact they apparently had both the private and public keys for the credit card hashes in the same location as one another is beyond belief. The very fact that Linode failed to mention they made a deal with the attackers and then reneged on it all without telling anyone makes me sick. I don't want to bash Linode purely because everyone else is, I am legitimately concerned here that my personal details have been compromised. I thought Linode was different but based on their lack of transparency in this matter, I'm seriously considering just moving all of my sites to DigitalOcean, Rackspace or even AWS instead. This makes me wonder who originally cleared them for PCI compliance in the first place. This is a huge violation of trust and now I've got to keep my eyes focused on my credit card statement for fraudulent transactions, the bank I am with ANZ however has great fraud detection systems and considering I'm in Australia any transaction should be easily reversible, but the fact there is a possibility my card could be fraudulently used saddens me. Linode needs to come clean about this situation now.
- thaumaturgy 14y agoLinode hasn't been very forthcoming in the past where security "incidents" are concerned: http://arstechnica.com/business/2012/03/bitcoins-worth-228000-stolen-from-customers-of-hacked-webhost/ http://arstechnica.com/business/2012/03/bitcoins-worth-22800... http://forum.linode.com/viewtopic.php?f=20&t=8509 http://forum.linode.com/viewtopic.php?f=20&t=8509 I had really hoped that they had changed their stance on incident management. If it's true that they suppressed information about a possible wide-scale compromise where customer data could have been affected, then despite everything else about their service that's so great, there's no way anyone should want to continue to be a customer there. Given Linode's past behavior and the information provided in the IRC chat, I think there's reasonable suspicion that customers' password hashes were stolen and Linode wasn't completely honest in their recent email to customers.
- taylorbuley 14y agoDid you see http://www.linode.com/linode4.css http://www.linode.com/linode4.css and http://www.linode.com/linode3.css http://www.linode.com/linode3.css? Nevermind the security concerns. These guys aren't using version control!
- douglasheriot 14y agoRenaming CSS files with numbers or whatever is one legitimate way to handle cache invalidation (not evidence of not using version control)
- laxk 14y agoIt is not the best way to handle cache invalidation. Why not /linode.css?v=<file_timestamp> ?
- thaumaturgy 14y agoThis is inconsequential.
- iriche 14y agoAnd right now we got confirmed on IRC that data is out, we do not know how much, 4 last numbers of CCs are out but that doesn't mean that full CCs are out. E-mails and logins are also out it seems.
- duskwuff 14y agoLast four digits of CC#s are often used to identify them to users ("Visa ending in 1234"), and are specifically OK to store in cleartext. So that's not necessarily a big deal.
- jtokoph 14y agoOFTC has disabled Linode IRC channel: * mode/#linode [+m] by tjfontaine <tjfontaine> this is what I'm going to say, as a network representative <tjfontaine> regardless of what has or has not happened with linode, OFTC cannot tolerate release of sensitive information with itself as that mechanism <tjfontaine> this channel is moderated until staff determines otherwise
- regecks 14y agoChannel now unmoderated. Edit: HTP came in and trolled (pretending to be ex-Linode), re-moderated.
- antsam 14y agoThis is disappointing and scary. A friend on another forum posted that some guy on IRC told him the last 4 digits of his CC and his e-mail address. I just called my bank and cancelled my current CC and give me a new number. I really liked Linode too :(
- dhess 14y agoFYI, the last 4 and your e-mail address are both visible in plaintext from your /account page in Linode Manager. Obviously, still disappointing and scary, but it doesn't necessarily mean that whoever has that information also has the full CC number.
- cjh_ 14y agoIf this is indeed true I will be very disappointed, I have had an otherwise great relationship with Linode. I await for more data and hopefully an official response from Linode. If the worst case is true, what are some good alternatives for Linux VPS hosting?
- mikebailey2 14y agoI've seen no evidence of passwords or credit card numbers being accessed. The purported "evidence" is a list of supposed entries in a public_html directory. https://bin.defuse.ca/hq0Ay8RzpKdR6vQwYxnmhc https://bin.defuse.ca/hq0Ay8RzpKdR6vQwYxnmhc Has anyone seen any evidence that this is not simply a hoax?
- unnali 14y agoWell, yes: try some of those files out: http://linode.com/MyAddress.class http://linode.com/MyAddress.class http://linode.com/y_key_57284cb2de704e02.html http://linode.com/y_key_57284cb2de704e02.html http://linode.com/ispcheck http://linode.com/ispcheck http://linode.com/k5_3 http://linode.com/k5_3 etc.
- icn2 14y agoI dropped linode two months ago. Hope they have purged my cc information from their system. Well I logged in just now with old credentials. Cc information is still there, not so good...
- yarou 14y agoSad day to see that Linode is not immune to data breaches. That being said, I don't necessarily support the witch hunt that seems to have taken place on its reputation.
- huobazi 14y agowhy not use Paypal or AliPay ?
- huobazi 14y agohttp://ruby-china.org/topics/10239 http://ruby-china.org/topics/10239 http://ruby-china.org/topics/10234 http://ruby-china.org/topics/10234
- psteyn 14y ago06:15 < gkmngrgn> hello, i forgot my password and linode's email reminder service doesn't work. i checked spam box but there's no email from linode. 06:15 < shmoon> ryannn: can you give him the password? 06:15 < scottymeuk> shmoon: damn you, you beat me to it! 06:23 < ryannn> shmoon, sorry I only have the sources on my server 06:23 < ryannn> db is on my desktop 06:24 < scottymeuk> ryannn: so your not in this to do large scale damage, only after a few clients?
- hevara 14y agohttp://blog.linode.com/2013/04/16/security-incident-update/ http://blog.linode.com/2013/04/16/security-incident-update/
- godgod 14y agoBeing a former customer I decided to contact Linode support. I wanted to know if we have anything to worry about as we used to have a credit card on file with them. Notice how they say "Decrypted" which to me is not the same as NOT COMPROMISED. Here is their response: Thank you for reaching out to us. We do archive customer credit card details. At this point there is no evidence that customer credit cards have been decrypted.