I've been working on this problem, in various forms, for the last ten years. It's pushed me to write https://github.com/aphyr/reimann https://github.com/aphyr/r

I've been working on this problem, in various forms, for the last ten years. It's pushed me to write https://github.com/aphyr/reimann https://github.com/aphyr/reimann, a network event stream processor for centralized graphing, metrics, dashboards, alerting, and analytics. It makes it easy to forward events to other monitoring systems, too. I'm using it in production at http://showyou.com http://showyou.com now; after I'm comfortable with its stability under load, I'll make an official release--probably within a month. [edit] I can also attest to the awesomeness of Boundary's platform. These guys have a killer UI, excellent reliability, and collect important, typically invisible data. I started work on Reimann because I needed to handle more than just network traffic--from the rate of feed item fanouts to a breakdown of memory consumption across all hosts. I also have different dashboard requirements. Regardless, I'm excited to see Boundary's take on the problem.