4 ms·
They all sort of suck to be honest. The least suck has actually been hosted Google Cloud Logging of late, it's just "not bad enough" to get the job done. When
by jpgvm 2y ago
They all sort of suck to be honest. The least suck has actually been hosted Google Cloud Logging of late, it's just "not bad enough" to get the job done.
When I worked at Postmates we had a proprietary log search built on Clickhouse which was excelent. The same idea was also implemented concurrently at Uber (yay multiple discovery) and is documented at a relatively high level here: https://www.uber.com/blog/logging/ https://www.uber.com/blog/logging/
If gun was placed to head I would rebuild that over running the existing logging solutions.
I also worked for several months on building my own purpose built logging storage and indexing engine based trigram bitmap indices for accelerated regex searches ala CodeSearch but I ran out of motivation to finish it and commercialisation seemed very difficult, too much competition even if that competition is bad.
Really really should get around to finishing it enough that it can be OSSed at least.
- shooker435 2y agosounds like Chronosphere
- Havoc 2y agoCan you stream self-hosted clusters logs in GCP?
- jpgvm 2y agoYou probably could. Easiest way would probably be to standup a GKE cluster quickly and then copy out the fluentd config.