5 ms·
Cloudwatch logs have been a big game changer versus on-disk logs for us. Getting into larger clusters (and larger log files), figuring out what’s happening in l
by awinder 8y ago
Cloudwatch logs have been a big game changer versus on-disk logs for us. Getting into larger clusters (and larger log files), figuring out what’s happening in log files became somewhat arduous. https://github.com/jorgebastida/awslogs https://github.com/jorgebastida/awslogs for viewing / tailing / searching is a lot easier. It’s also fairly straightforward to get logs streamed through to ELK hosted within AWS, if you’re interested in that angle.
- tjholowaychuk 8y agoDo you guys find CloudWatch logs too slow? Even on very small apps I find searching the past few days takes minutes (5-10m), but I'm using "structured" JSON logs as well.
- kondro 8y agoCloudWatch is definitely a write optimised product. Any kind of reading or searching is pretty terrible. I’m sure AWS would recommend you use Kinesis Firehose or something to put in ElasticSearch and use Kibana or something. But I would be great to have an equally scalable log parser/searcher.
- CSDude 8y agoAll of the Cloudwatch is very slow (Logs & Metrics & Alarms) we hate it
- kolanos 8y agoHave you tried IOpipe? [0] [0]: https://iopipe.com https://iopipe.com Disclosure: Work on the Python and Go agents.
- awinder 8y agoWe haven’t had issues but we keep our time windows short for any searching through logs (and we don’t use json logs so that’s an interesting difference). We use other systems for longer range log analysis.