7 ms·
Announcing Graylog v1.0 GA
- koliber 12y ago"Users who tested the beta and release candidate versions of v1.0 reported huge improvements in performance and stability. Some of them were unable to crash the system no matter how hard they tried." This statement from the page makes me conclude that others were indeed able to crash the system, perhaps without even trying too hard. My guess is that the statement should be re-worded.
- lennartkoopmann 12y agoThat is a very good point. We are in the process of changing that. :) The meaning should be that with v1.0 it is finally very hard to crash the system by overloading it. Previous versions were easier to crash by filling memory in load spike situations for example.
- tbdr 12y agoI was able to crash the system without even trying. After waiting for a 500MB something docker image download and running the container halted the host OSX machine while looping with errors (failed API connections, failed to load SIGAR, ...) The screenshots looked great but the first steps experience were a deal breaker.
- real_joschi 12y agoWe've tested the Docker image on Mac OS X with boot2docker but of course there are always things that can go wrong. It would be awesome if you could help us improve the Docker image by creating an issue at https://github.com/Graylog2/graylog2-images/issues https://github.com/Graylog2/graylog2-images/issues with the error messages you've encountered when starting the container.
- nonane 12y agoI just tried this with boot2docker on a OS X machine (Yosemite) and it went very smoothly.
- deleted 12y ago[deleted]
- teacup50 12y agoMaybe requiring a full VM when a standalone self-contained application will do is not the winning strategy.
- real_joschi 12y agoOh, we got both kinds. We got country and western. ;-) Seriously, the Docker image and the VM images are there to help people getting started and to quickly try out Graylog. We also offer regular OS packages in DEB and RPM formats (supporting Debian 7, Ubuntu 12.04 and 14.04, and CentOS 6) and a quick setup application (for a simple demo setup of Graylog and its dependencies). So choose your poison and be happy!
- michilehr 12y agoCongratulations to Lennart and his team!
- aerialcombat 12y agoSo what is it exactly?
- lennartkoopmann 12y agoA log management tool: You send all your local log messages/files to a central place (Graylog) and have unified searching, filtering, monitoring, alerting, forwarding, ... All open source.
- aerialcombat 12y agoCall me stupid, but I've always learned better from examples than descriptions. So it's a log management tool. I can have my app write logs or files into Graylog, then I can handle the logs/files within Graylog much more easily than, say, if I were to write my own code to make some kind of sense with the log data. Am I understanding this correctly? So I can maybe tell easily where users had problems with my app, or I can even use it as some kind of analytics program for my app?
- deleted 12y ago[deleted]
- lennartkoopmann 12y agoExactly. Think of this search query you could do: source:your-app AND http_status_code:>=500 This would give you a list of all HTTP 500s of "your-app". Or: user_id:12346 AND http_status_code:>=500 ... to see all errors a user caused after customer care called you, reporting an error the user got. Stacktrace is there immediately without having to find the right log file on the right web server.
- hijinks 12y agocorrect.. its a way for you to index and search through logs and easily pull out where issues might be happening. Its like splunk but not as poweful
- aerialcombat 12y ago
- gbrindisi 12y agoI'm evaluating Graylog as a piece in our monitoring infrastructure. Does anybody have some experience using it in production?
- whiskykilo 12y agoWe have been using it in production, it rocks! Very powerful tool and the company behind it is full of great, helpful folks.
- gtirloni 12y ago+1 The solution seems neat. It'd be nice to know who is using it in production, how big is their environment, etc. I couldn't find much information online.
- whiskykilo 12y agoWe're receiving roughly 200 msgs/s in our environment. We have it set up in an active/active environment across two data centers. It's been rock solid for us. It takes a little bit of time to get certain applications to send messages properly, but once you do, it's pure gold. We are using NXLog on our Windows servers to send event log messages in GELF format. This allows us to truly delve in and search event logs so much easier than what we normally would be able to in Windows.
- acamilo 12y agowe are using it in production and works very well. ~200 clients sending events with a total of 63,996,350 events.
- druiid 12y agoYep! We do about 5k events/sec and it holds up pretty well as long as you throw enough memory at it (It's a java app). Make sure you have a cluster though if you're going to be doing those kinds of levels. Feel free to respond if you have any other questions. I'll be testing out the 1.0 release myself today.
- nirvdrum 12y ago
- losvedir 12y agoSo is this in the vein of Splunk, say? My company also uses logentries, and has been quite happy with it, but a hosted open-source tool would be great.
- lennartkoopmann 12y agoYes! Let me know if we can help with any questions. See also: http://www.infoworld.com/article/2885752/log-analysis/open-source-graylog-puts-splunk-on-notice.html http://www.infoworld.com/article/2885752/log-analysis/open-s...
- chorizos22 12y agoCRAPWARE
- NextPerception 12y agoI looked around a little bit on the web page but the answer to my two questions was not immediately apparent to me. (Note: I might just be blind) 1. Can I set up a second Graylog Server as a failover with automated recovery and log syncing when both nodes come back up? 2. Can I run it on any cheap cheap embedded platforms like a raspberry pi or beagleboard?
- lennartkoopmann 12y agoYes, you can set up as many Graylog servers as you want and put them behind a load balancer or integrate any kind of failover you want. We do not recommend it running on extremely small platforms like a raspberry pi, but a very small VM (we have OVAs and other virtual appliances ready) is able to process a lot of messages already.
- toomuchtodo 12y ago> and put them behind a load balancer Only if your load balancer supports UDP, which most don't. You'll most likely need to use DNS load balancing in this case unless you're sending GELF messages with TCP.
- zantana 12y agoIs Graylog effectively a single product that does the whole thing? My dismay with the ELK stack is you are effectively juggling 3 separate products with different release cycles.
- lennartkoopmann 12y agoYes! We have put a lot of effort into making this one thing. The graylog-web-interface connects to the graylog-server REST APIs and that is it. You can manage and monitor the whole system from the graylog-web-interface. Both components are always released together.
- mrits 12y agoFinally, less flexibility!
- deleted 12y ago[deleted]
- crudbug 12y agoThe good thing about separate projects is that you can reuse Kibana in other projects. e.g www.packetbeat.com
- boothead 12y agoCould anyone give an executive summary of the differences with the ELK stack?
- lennartkoopmann 12y agoThis might help: http://docs.graylog.org/en/1.0/pages/ideas_explained.html http://docs.graylog.org/en/1.0/pages/ideas_explained.html
- boothead 12y agoPerfect! Thank you.
- peterstjohn 12y agoHurrah - good to see that the Elasticsearch dependency is no longer locked to a rather old version (that bit me a few times when setting up a cluster last year). I'm still a bit wary about having to spin up MongoDB for it as well, though…
- EvanAnderson 12y agoThe MongoDB requirement gives me pause, too. I've wanted to give ToroDB (https://github.com/torodb/torodb https://github.com/torodb/torodb) a try for awhile now, and I think I'm going to see if Graylog will talk to it for grins.
- real_joschi 12y agoPlease let us know how it worked out! ;-)
- peterwwillis 12y agoSo there's Graylog, then there's Graylog2, then there's the new-and-improved Graylog.... If someone forks it will there be a new-and-improved Graylog2?
- benjarrell 12y agoYea I am confused, is this different from Graylog2?
- lennartkoopmann 12y agoWe decided to drop the "2" from the name to have less confusion with "Graylog(2) 2.0" - Point taken here, the initial "2" was not a good idea :D (The documentation may need a "History" page)
- peterwwillis 12y agoNo Graylog3?
- real_joschi 12y agoAs Men in Black 3 wasn't that great and Star Wars: Episode 3 also had its lengths (don't get me started about Lethal Weapon 3!), we tried to avoid that. Let's see how Ghostbusters 3 will work out and maybe (but just maybe) we'll think about releasing Graylog3. ;-)
- peterwwillis 12y ago"Logbusters." I ain't afraid of no log!
- whytry 12y agoSo... it runs in a JVM? ok....
- kiyoto 12y agoSome folks in the Fluentd community uses Graylog2+Fluentd as an alternative to EFK (Elasticsearch Fluentd Kibana) See http://www.fluentd.org/guides/recipes/graylog2 http://www.fluentd.org/guides/recipes/graylog2
- gameguy43 12y agoOh maaaaan the old graylog2 site had probably my /favorite/ branding in all of software. The heading was "Manage your logs in the dark and have lasers going and make it look like you're from space." https://web.archive.org/web/20130302051347/http://graylog2.org/ https://web.archive.org/web/20130302051347/http://graylog2.o... Sad to see it's gone all "professional" now :( The web service had some hilarious bits too. Does it still say "enraging gorillas... | mounting party hats" etc when you log in?
- francesca 12y agoI miss that too. Also the Party Gorilla was fantastic. Either way, glad to see the project has grown!
- stephen 12y agoLooks really great. Has anyone compared this to CloudWatch Logs? When I initially looked at CW Logs, it seemed fairly incomplete compared to Splunk.
- saosebastiao 12y agoIs there any way to not use MongoDB in the backend?
- crudbug 12y agoI had the same question. Why are they using MongoDB when Elasticsearch can do the same job, may be better.
- real_joschi 12y agoWe don't want to use ES too much as Graylog should still work when ES has some problems. It's currently the default output but that may change in the future for special use cases. That being said, we're aware that many people don't like the dependency on MongoDB and we'll work on that.
- arca_vorago 12y agoCan I just have on thing that does event logs and snmp and uptime and alerting for internal and external devices in a secure way all in one package? I'm so tired of having to have 30 different softwares installed just to accomplish 3 things.
- listic 12y agoWhat other pieces of software are there in this class? Who are the competitors?
- csears 12y agoSplunk and ElasticSearch + LogStash + Kibana (ELK) are two popular solutions in the same space.
- minalecs 12y agoI've tried and used sumologic . It may not be appropriate for some companies because everything is sent and analyzed on their cloud infrastructure, but is a very good product.
- dwwoelfel 12y agoI've used Splunk in the past, which is very good. Their search interface and field extraction let you perform complex queries on your logs. We used the following query to identify users that were having a bad time on the site, by counting slow queries by user and adding them up: "slow query" source="/var/log/application.log" | rex field=_raw "in (?<time>\\d+)ms" | search time>2000 | rex field=_raw "User: (?<login>[^\\s]+) " | top login You can do much more complex queries--it's better to think of Splunk as a temporal database than a log aggregator. Does anyone know if Graylog or other logging solutions can do the same thing? Splunk is amazing, but it's annoying to manage the infrastructure and it's crazy expensive.