3 ms·
OpenTSDB itself is pretty easy to configure, the tsds are stateless and you can spin up some for ingest, some for frontend/grafana etc by blanket applying a sma
by kev009 11y ago
OpenTSDB itself is pretty easy to configure, the tsds are stateless and you can spin up some for ingest, some for frontend/grafana etc by blanket applying a small config file. You can use any of TCP, HTTP, or DNS load balancing to handle failure depending on how you ingest. It's easy enough to build packages for, and we recently committed it to FreeBSD ports where you can get a whole up to date HDFS/HBase stack without 3rd party garbage.
The hard part is HBase and to a lesser degree HDFS.. there are just a lot of things to read and learn about, and failure to address one of them will eventually cause interesting struggles. That said, my company looked at the field in 2012 and chose OpenTSDB, and it's handled things well enough considering fairly poor configuration of HBase. We recently reevaluate the space and tried Influx and Karios. Influx fell on its face in several ways that will take years to fully iron out, Kairos trades one set of evil for another, so we decided to do some learning and redeploy OpenTSDB correctly. As far as open source options, it's far ahead in the battle hardened department.
If you want to consider it, I would advise checking out some of the slides/videos on http://www.hbasecon.com/ http://www.hbasecon.com/ - these two being the most critical:
* OpenTSDB and AsyncHBase Update
* HBase Performance Tuning @ Salesforce
HBase seems pretty vibrant. There's been a lot of progress with things like WAL shipping and performance tweaks like SSD block caching, off GC heap support, read access from multiple regionservers. OpenTSDB plugs along at a slower pace, but it's much more professional than i.e. Influx changing storage engines 5 time and getting worse with each. The OpenTSDB 2.2 release looks really exciting and fixes some hard high rate problems for both reads and writes: http://opentsdb.net/docs/build/html/new.html#id1 http://opentsdb.net/docs/build/html/new.html#id1
In the commercial space, Circonus looks pretty interesting and comes built and recommended by people I trust. It goes a lot farther than metrics storage. I wasn't able to get my management to do more than a video call to really dig in and evaluate it myself.