4 ms·
Nice! I agree Cortex's operational overhead can be quite high. Good news! We are going to fix that. We've got PRs open to add local storage (based on BoltDB)
by netingle 8y ago
Nice! I agree Cortex's operational overhead can be quite high. Good news! We are going to fix that. We've got PRs open to add local storage (based on BoltDB) to remove the dependancy on DynamoDB/Bigtable, and I've almost finished a single binary, non-microservices version of Cortex.
If you want a sneak peak, checkout grafana/loki; its based on Cortex and has all theses features - buts it for logs, not metrics.
- grumpydba 8y agoHi, It is my understanding that Prometheus's storage engine is LSM based, and uses a compression scheme inspired by gorilla. Boltdb is basically a btree which causes more write amplification. Maybe you should try badgerdb.
- bboreham 8y agoCortex also uses gorilla-inspired compression, using the Prometheus source code. After compressing timeseries they are stored and indexed using a database-like thing, typically DynamoDB or Bigtable, but soon BoltDB will be an option. (I am a Cortex maintainer)