3 ms·
Companies don't dream of staying small, and they want solutions that scale with them. If they do end up growing, planning ahead with a purpose-built solution sa
by otterley 10y ago
Companies don't dream of staying small, and they want solutions that scale with them. If they do end up growing, planning ahead with a purpose-built solution saves time and resources recouping technical debt.
- flukus 10y agoAnd many companies stay small or disappear because they wasted resources on problems they didn't have.
- otterley 10y agoIt's a risk either way.
- flukus 10y agoBut an equal risk? For most companies it isn't. Their are more failed big dreamers than companies that missed the big time because they couldn't scale.
- otterley 10y agoIt's a good question, and I don't know where the quantitative data exists to answer it. My personal preference is to hire experienced teammates who have solved similar problems in the past, because at most levels of scale (other than, say, Google's or Facebook's), few problems are truly novel. So it's reasonably possible to predict where the business will be WRT technological requirements in, say, 1 to 3 years, sometimes 5 if you're just getting started, and plan accordingly. In the case of this particular problem (time series data), there are some pretty easy and scalable answers out there -- Datadog, SignalFx, Wavefront, Prometheus, etc. to start with. So it's not like you have to waste a bunch of opportunity cost going out and building a solution.
- deleted 10y ago[deleted]
- solidsnack9000 10y agoWith references to infrastructure in particular -- not all aspects of the business -- even very large companies rarely need specialized storage engines for logs or metrics. A thousand servers don't generate enough data for it to matter. We've seen something of a convergence here with ELK -- people push their syslog into the same system they use to provide general text processing for the application, instead of having a separate/weird storage engine for infrastructure logs.