6 ms·
What is it about elastisearch that dopey people stuff them with information and leave them on the open internet, all of the time?
by Spooky23 7y ago
What is it about elastisearch that dopey people stuff them with information and leave them on the open internet, all of the time?
- Filligree 7y agoIt's the default configuration. Unless you go out of your way to ensure security, you'll get this result.
- thekyle 7y agoI believe Elasticsearch does not have authentication built into the open source version.
- btown 7y agoThis is no longer true, but ONLY as of May 2019 in response to pressure from the containerization world. https://www.elastic.co/blog/security-for-elasticsearch-is-now-free https://www.elastic.co/blog/security-for-elasticsearch-is-no... It’s not default insecure like Mongo was - this was far far worse. You couldn’t even prototype in a secure way even if you wanted to, without a massive contract. One of the most frustrating things in software - IMO they deserved to have AWS commoditize their stack.
- xvector 7y agoPerhaps it's a controversial opinion, but I feel like it's just flat out unethical to relegate basic security to the paid/enterprise version of your product. Of course it's unethical to use said product to store real user data too, but the road goes both ways.
- bouke 7y agoJust deploy it on your local network. No need to expose it to the internet. Sure, authentication is a nice bonus, but a simple firewall goes a long way.
- jturpin 7y agoI don't get why it ever needs to be on the internet even when it does have authentication. Surely the public/private subnet split is a common practice.
- kirstenbirgit 7y agoThe way I see it, password auth for db servers is the last-resort protection mechanism. If you get to the point where it’s what’s protecting your data, you’re already fundamentally screwed.
- CydeWeys 7y agoYou should definitely have it too, though.
- CydeWeys 7y agoUnless the private subnet is airgapped from the Internet, it's not a good enough separation. Hell, even if it is airgapped, it can still be compromised by viruses on USB sticks and such. You should never be leaving sensitive systems wide open, period, regardless of how secure you might think that network is. Thousands of data breaches have been caused because networks didn't end up being as secure or as separated as hoped for.
- CydeWeys 7y agoDefense in depth is important. Lots of data breaches have been caused because things that should have just been viewable from a local network, weren't, or the network was compromised. Unless you think every single employee is invulnerable to spear-phishing (which is impossible), you should never be leaving anything sensitive wide open on your local network.
- shawnz 7y agoThe module is now free, but it's not open source, it is licensed under the proprietary Elastic license. The source is available but it is not licensed to be used with anything except the Elastic licensed version of Elasticsearch (not even the Apache licensed version of Elasticsearch) However, Amazon has thankfully released a free and open source security module for Elasticsearch as part of their Open Distro project. It is based on another project called Search Guard. See: https://opendistro.github.io/ https://opendistro.github.io/
- monksy 7y agoWe don't have sysadmins anymore "because of the cloud"
- mbreedlove 7y ago"Sysadmins? No, we just have devops now!"
- dvfjsdhgfv 7y agoMany managers use "devops" as an excuse to put a lot of burden on a small team, then this team is doing their best to automate managing a large number of machines but it's physically impossible to delve deeper into details and polish things, hence mishaps are bound to happen. And don't get me started on on what is happening inside containers.
- deleted 7y ago[deleted]
- tylfin 7y agoSorry but I'd like to get you started on what is happening inside containers ;P Specifically can you go into more details about what worries you with containers. Is it insecure images with out of date software, or risky applications inside the containers? Something else?
- mschuster91 7y agoLet's imagine your JIRA is insecure, someone owns it and obtains RCE, then does a privilege escalation on the host, whoops suddenly all services are accessible whereas that would have required more steps and owning in the old one-vm/bare metal-server-per-service model.
- arpa 7y agoEscaping properly namespaced/pivot_root'ed environment and owning a host is non-trivial too.
- jacquesm 7y agoIn a word: devops. Developers are not operators and operators are not developers. The whole idea that we can do away with this specialization and and relegate operations to the people that create software because it is now possible to script infrastructure and to install complex packages with a few mouseclicks does not make it true. Operations and the complexity that goes with it is a job in its own right, no competent operator would have left this situation as it came out of the box.
- AnIdiotOnTheNet 7y agoA combination of businesses' desire to spend less on labor and your average developer's inherent sense of superiority mean this trend is unlikely to go away any time soon though.
- arpa 7y agoI believe you can be both competent operator and a reasonable developer at the same time. The skills complement each other nicely. It is a lot of work to be these things though.
- farisjarrah 7y agoElasticsearch started life as a free product and security was a paid addon to that product via the X-Pack, now Elastic Co has made the security stuff free but people still don't implement it. Elasticsearch is insecure out of the box and it takes extra steps to get it secured, and most people don't do those steps even though its pretty well documented right here: https://www.elastic.co/guide/en/elasticsearch/reference/current/configuring-security.html https://www.elastic.co/guide/en/elasticsearch/reference/curr...
- blinkingled 7y agoSecurity features in Elastic still require paid subscription. The link you pasted even says that. You can use the xpack features for free on a trial basis but for production use you're required to buy a license.
- farisjarrah 7y agoThank you for the correction. I thought I heard rumblings about their X Pack being free, but I had probably just heard about the trial.
- blinkingled 7y agoYou can use the Amazon OpenDistro provided plugins on top of oss ES to enable security features.
- jturpin 7y agoThis is not true, you can use some xpack security features such as basic auth, client TLS and node-to-node TLS for free. We use basic auth (with Vault integration) at my company using just the basic license. https://www.elastic.co/subscriptions https://www.elastic.co/subscriptions has details on the subscription levels.
- blinkingled 7y agoThanks, I did not know about basic license. Although if you wanted to use OSS license my point still stands. (Not sure what restrictions the basic license brings so for some the only option might be the OSS license.)
- fulafel 7y agoES is very poorly engineered but unexplainably popular. The interesting question is why it's popular.
- freeone3000 7y agoFast free full-text search over arbitrary documents. It solves a problem lots of people need.
- fulafel 7y agoIirc it doesn't have very good support for document formats (eg pdf, office). It's also a huge resource hog so not particularly fast in the bang for the buck sense.
- tristor 7y agoHonestly, some of the most preventable and dumbest outages and failures in my career have involved ElasticSearch. Most of the time it's deployed and managed by a dev team with no operational oversight, and therefore nobody to think about or catch these types of issues. It is compounded by the fact that all the security features in ES were paywalled for a very long time and most technologists don't understand basic networking anymore. As many other answers to your query have stated, this is caused by a broken understanding of the devops methodology among organizational management forcing developers who are not competent in systems administration to be responsible for these systems.