3 ms·
I personally see the flip side, the original logging service at 30k/mo is totally wild. How much data was being logged/searched if you don't mind me asking?
by layoric 6y ago
I personally see the flip side, the original logging service at 30k/mo is totally wild. How much data was being logged/searched if you don't mind me asking?
- etxm 6y agoAbout 300-600GB / hr. Data retention was based on a few different rules but could be stored for up to a month. 30k was ingress and ETL, that amount didn’t include storage. Not sure what storage costs were off-hand.
- layoric 6y agoThanks for sharing, that's a lot of logs but another good example of how linear scaling costs hurts. A lot cheaper than standard AWS CloudWatch which reckons it would be $200k+ a month.. but though 600GB an hr is not an easy problem to solve but that is a hell of a premium on both.