3 ms·
> The datadog-agent inside our kube clusters was constantly one of our largest logging services This. Just this. Until I recognized this, these agent logs were
by nrmitchi 7y ago
> The datadog-agent inside our kube clusters was constantly one of our largest logging services
This. Just this. Until I recognized this, these agent logs were making up more than 50% of our total log volume. These were, for the most part, a single log message that an APM was malformed.
I only noticed this when renewing my companies Datadog contract, and couldn't fathom how we had been generating so many logs.
I was pretty disappointed when their sales rep had been pushing us to increase our committed log volume, without mentioning that literally thousands of dollars per month was being spent for Datadog to send themselves their own logs. As far as I'm concerned these logs should either be filtered out of the index by default, or not count towards billing.