4 ms·
You're optimizing for the wrong thing. The hard part about this space isn't extracting value from data, it's physically shipping the data through the infrastruc
by sagichmal 6y ago
You're optimizing for the wrong thing. The hard part about this space isn't extracting value from data, it's physically shipping the data through the infrastructure and into the relevant systems. Metrics are so great compared to logs precisely because they're precalculated (read: highly compressed) before leaving the originating service.
- detaro 6y agoThat does sound like you are assuming that everyone always talks about large-scale environments with dozens or more machines?
- sagichmal 6y agoEverything we're talking about here is trivial until you reach a minimum scale. "Dozens of machines" is still trivial, to be honest.
- detaro 6y agoNot for many people running such environments. So you either see with very minimal setups without tooling to help (which is survivable at small scales, but inefficient and mindnumbing), or towers of complexity that followed widely shared advice by people always assuming massive scale.