3 ms·

I'd love to hear more about how your data ingestion works. I'm thinking of implementing TimescaleDB myself, but in my initial read of the docs, the focus seemed

• dominotw 6y ago
  same way you'd insert data into postgres.
  • jbmsf 6y ago
    That's not really helpful. Let's assume you have a distributed system; you probably don't want all of your system components connecting directly to TimescaleDB. You also probably want to have some layer that implements queuing and handles back pressure if it can't insert into the database at the rate that events are coming in. You may want to batch insert data. I'd assume that most anyone building a system like this at scale has to solve these problems; does everyone roll their own?
    • k-rus 6y ago
      There are number of tools, which can be used in front of TimescaleDB or PostgreSQL. There are plugins for Telegraf, Kafka, Prometheus as described in https://docs.timescale.com/latest/using-timescaledb/ingesting-data https://docs.timescale.com/latest/using-timescaledb/ingestin... Timescale builds connector and entire workflow to run Prometheus on top of TimescaleDB and support Grafana in flexible way: https://github.com/timescale/timescale-prometheus https://github.com/timescale/timescale-prometheus
      • jbmsf 6y ago
        Perfect. Thank you for the reference.