3 ms·
Again, sales pitch aside, this is one of the handful of valuable LLM applications out there. Monitoring and observability have long been the exclusive domains o
by stego-tech 1y ago
Again, sales pitch aside, this is one of the handful of valuable LLM applications out there. Monitoring and observability have long been the exclusive domains of SRE teams in large orgs while simultaneously out of reach to smaller orgs (speaking strictly from an IT perspective, NOT dev), because identifying valuable metrics and carving up heartbeats and baselines for them is something that takes a lot of time, specialized tooling, extensive dev environments to validate changes, and change controls to ensure you don’t torch production.
With LLMs trained on the most popular tools out there, this gives IT teams short on funds or expertise the ability to finally implement “big boy” observability and monitoring deployments built on more open frameworks or tools, rather than yet-another-expensive-subscription.
For usable dashboards and straightforward observability setups, LLMs are a kind of god-send for IT folks who can troubleshoot and read documentation, but lack the time for a “deep dive” on every product suite the CIO wants to shove down our throats. Add in an ability to at least give a suggested cause when sending a PagerDuty alert, and you’ve got a revolution in observability for SMBs and SMEs.
- JimBlackwood 1y agoAgreed! I see huge gains for small SRE teams aswell. I’m in a team of two with hundreds of bare metal machines under management - if issues pop up it can be stressful to quickly narrow your search window to a culprit. I’ve been contemplating writing an MCP to help out with this, the future seems bright in this regard. Plenty of times when issues have been present for a while before creating errors, aswell. LLM’s again can help with this.
- chupasaurus 1y ago> identifying valuable metrics and carving up heartbeats and baselines for them The first problem is out of reach for LLMs, the other 2 are trivial with convolutional NNs for a long time. > extensive dev environments to validate changes, and change controls to ensure you don’t torch production Are out of scope for observability.
- stego-tech 1y agoNot for small environments they’re not. If you say “observability” to a big Fortune company, they peg it to a narrow, specifically defined team and goal; that same word to a SMB/E is “oh, you mean monitoring and change control”. I used the word correctly for the environments I was describing. They’re just not accurate for larger, more siloed orgs.