3 ms·
I manage a fairly small ES cluster of 20 i3en.2xlarge instances that ingest data from 300+ apps. Yes, the only problem I see is the field type collision and it
by free652 6y ago
I manage a fairly small ES cluster of 20 i3en.2xlarge instances that ingest data from 300+ apps. Yes, the only problem I see is the field type collision and it happens occasionally.
Otherwise elastic doesn't require much operational time, may be an hour a week.
You pretty much want to keep your indices around 50gb and the ILM works well to manage that.
- pojzon 6y agoWhat about threadwriterejects and max-number-of-shards. If you don’t take into consideration how much data you ingest and in what format it should be afterwards and monitor that constantly: “You gonna have a bad time”. You can automate a lot of stuff around elasticsearch, but when you provide/source it within company - other teams may not be as knowlegable and can shoot themselves into the foot very easly. Ive seen it multiple times by now. People have no idea how to manage the size of their clusters.
- tgtweak 6y agoAnyone accepting freeform objects into a single ES index knows the pain of field type collisions But, most of the time, it "just works". Hearing these argument about rigid schemas saving time tells me that nobody has had to support teams with 200+ apps. ^ This guy actually manages infra