4 ms·
If you don't want it to hit disk, why don't you just not log to disk? Are you running a unix variant? There are several ways to do this. Why not log to /dev/
by krenoten 13y ago
If you don't want it to hit disk, why don't you just not log to disk? Are you running a unix variant? There are several ways to do this. Why not log to /dev/shm or a pipe, instead of changing nginx?
Rsyslog is also probably not the best choice for high volume log aggregation. It performs an rpc per message. That sucks. Use something that batches, like scribe.
- kul_ 13y agoI agree, If you are aggregating logs so small that they can fit into memory, most likely that you do not care where it goes. Otoh if the logs are enormous you must have robust periodic log aggregation jobs like map reduce to do that and it is must to have logs on disk. Moreover 50m/day is ~ 578/sec , which isn't huge for a cluster of servers.