4 ms·

Any recommendations for simple centralized logging for small/hobbist/non-profit projects? I'm basically looking for something self-hosted or cloud-based where

Any recommendations for simple centralized logging for small/hobbist/non-profit projects? I'm basically looking for something self-hosted or cloud-based where I can easily POST some data from Python/PHP/JavaScript/Bash running on two or three servers and easily have a look at the logs streaming in. Spinning up an entire Graylog seems overkill in order to log a couple of dozen lines per day.

phaer 6y ago
https://grafana.com/docs/loki/latest/ https://grafana.com/docs/loki/latest/ is pretty good for structured logging. But as always: depends on your needs especially with regards to indexing as loki stores only the raw log data and set labels. But putting new data into it via POST is pretty simple https://grafana.com/docs/loki/latest/api/#post-lokiapiv1push https://grafana.com/docs/loki/latest/api/#post-lokiapiv1push
whatl3y 6y ago
AWS CloudWatch logs is cheap and very easy to 1. integrate with existing loggers, 2. send logs to your desired log stream (and to send to multiple streams depending on if your in dev, testing, prod etc.) and 3. fetch/review via CLI or their web interface.
georgekin 6y ago
Check out https://datalust.co/seq https://datalust.co/seq. Supports native ingestion over HTTP, as well as plugins for syslog/GELF. Can run locally as well as in docker, so it runs anywhere.
user5994461 6y ago
Suggest to try syslog-ng. Have a syslog-ng running locally on all your hosts and forwarding logs to a central one. Applications can easily send logs to syslog, all languages/loggers support it. The central syslog can listen for remote logs and save everything into /storage/hostname/year-month-date/file.log for example. This allows you to grep everything from that host. It's simple and it uses very little resources.
wsargent 6y ago
Honeycomb has a free tier that is very generous: https://www.honeycomb.io/pricing https://www.honeycomb.io/pricing? You can set up with one of their Beelines, or just send JSON to the REST endpoint.

phaer 6y ago

https://grafana.com/docs/loki/latest/ https://grafana.com/docs/loki/latest/ is pretty good for structured logging. But as always: depends on your needs especially with regards to indexing as loki stores only the raw log data and set labels. But putting new data into it via POST is pretty simple https://grafana.com/docs/loki/latest/api/#post-lokiapiv1push https://grafana.com/docs/loki/latest/api/#post-lokiapiv1push

whatl3y 6y ago

AWS CloudWatch logs is cheap and very easy to 1. integrate with existing loggers, 2. send logs to your desired log stream (and to send to multiple streams depending on if your in dev, testing, prod etc.) and 3. fetch/review via CLI or their web interface.

georgekin 6y ago

Check out https://datalust.co/seq https://datalust.co/seq. Supports native ingestion over HTTP, as well as plugins for syslog/GELF. Can run locally as well as in docker, so it runs anywhere.

user5994461 6y ago

Suggest to try syslog-ng. Have a syslog-ng running locally on all your hosts and forwarding logs to a central one. Applications can easily send logs to syslog, all languages/loggers support it. The central syslog can listen for remote logs and save everything into /storage/hostname/year-month-date/file.log for example. This allows you to grep everything from that host. It's simple and it uses very little resources.

wsargent 6y ago

Honeycomb has a free tier that is very generous: https://www.honeycomb.io/pricing https://www.honeycomb.io/pricing? You can set up with one of their Beelines, or just send JSON to the REST endpoint.