3 ms·
GCP is great but we couldn’t find a way to get logs to go anywhere but to StackDriver and it being so expensive we had to jump ship because of it. Basically try
by gigatexal 8y ago
GCP is great but we couldn’t find a way to get logs to go anywhere but to StackDriver and it being so expensive we had to jump ship because of it. Basically try as we might all the pods that ran our containers had stderror and stdout hijacked by StackDriver
- manigandham 8y agoYou mention pods so are you talking about GKE clusters? If so, Stackdriver integration is just another service installed when you setup your cluster (using fluentd as the agent). There's also an updated beta version of this monitoring, but you can disable all of it easily in the GKE console with a few clicks. Container output isn't hijacked, it's all logged to files, and those files are tailed by the logging agents. You can run multiple logging agents, for example we use https://logdna.com/ https://logdna.com/ (highly recommended) and it works fine in addition to stackdriver logs.
- gigatexal 8y agoOk this might be embarrassing to admit but when we used GKE about 8 months ago we tried to do this but we couldn’t get our own logging to get anything from the pods. Maybe the tech lead was biased and wanted to go to AWS all along. I’ll have to take another look at it because I liked the service. What I didn’t like is that I on many occasions saught help from Google but got no response. We didn’t pay for support but just an email a few days later from support showing the methods to disable it and maybe a look into why our on cluster logging tools weren’t ingesting anything would have been nice.
- xdominator 8y agoIt looks like you can disable logging for specific clusters if needed https://cloud.google.com/kubernetes-engine/docs/how-to/logging#disabling_logging https://cloud.google.com/kubernetes-engine/docs/how-to/loggi..., or set up log exclusion to reduce costs https://cloud.google.com/logging/docs/exclusions/ https://cloud.google.com/logging/docs/exclusions/ The logs are still available in the cluster (not hijacked) and you can configure your own export mechanism.
- manigandham 8y agoWhat support did you contact if you weren't paying? Support isn't perfect but I find it hard to believe you got no response at all. Staff and community is also active on the gce-discussion [1] group and StackOverflow [2]. 1. https://groups.google.com/forum/?hl=EN#!forum/gce-discussion https://groups.google.com/forum/?hl=EN#!forum/gce-discussion 2. https://stackoverflow.com/questions/42380626/how-do-i-disable-the-stackdriver-logging-agent-in-a-cluster https://stackoverflow.com/questions/42380626/how-do-i-disabl...
- gigatexal 8y agoI forget who I emailed. I got a response that they’d look into it but a month later nothing.
- brown9-2 8y agohijacked? it is an add-on that is enabled by default which can easily be disabled.
- pm90 8y agoUhhh... you can disable log ingestion by Stackdriver. And send your logs anywhere you want really.