4 ms·
Show HN: Wild Moose – Autonomous agent for production debugging
Hi Hacker News! We launched an autonomous agent that helps debug production issues, and we’re curious to get your feedback.
Today's GenAI devtools, such as Copilot, are limited: they are great for writing code, but we all know that programming is only 20% coding, and 80% debugging.
So how can GenAI be used for debugging? As opposed to code completion or test automation, production debugging is not about generating text. Debugging is mostly about root-cause analysis. We realized two things:
1) Generative AI is drastically changing the way we work with data, thanks to its ability to not only generate queries, but also run code and analyze unstructured data. This enables building better data-exploration experiences with far more intuitive interfaces.
2) RCA is all about exploring different types of data. When you don’t know why a transaction was dropped or which customers are affected – you explore metrics, logs, your code, other people’s code, old slack messages, and whatnot, to figure out what’s broken.
Putting those two together, we built an autonomous agent that helps debug production issues. Our LLM "moose" (ok, it's corny but we like it) connects to your logs, metrics, and other observability data, and lets you extract and analyze them by conversing with it. Once it gets a task, it will start reasoning, invoking APIs, and running code, until it comes back with an answer.
For example, when requested to “show me IDs of transactions that took over 1 minute today”, it will fetch those transactions from Datadog for you. You might then ask it if long-running transactions correlate with a metric such as DB CPU load. It will fetch the metric values, visualize them on a graph alongside the long transaction frequency, and give you the answer.
Our software both runs code and invokes API calls; the interplay between these is nontrivial to design and a fertile ground for innovation. There are “textbook” solutions to let agents write and run code (open sourced by, for example, Open Interpreter), and also to invoke tools/APIs (for example, Gorilla). But doing both together is harder, and yet required. We welcome your thoughts on this!
Try our tool with your Datadog’s logs and metrics >> https://app.wildmoose.ai/slack/install https://app.wildmoose.ai/slack/install
Setup demo >> https://www.loom.com/share/9a4adc39806742c48d14cdd39da6e560?sid=3d518e11-64b3-4139-82fd-451a3f055940 https://www.loom.com/share/9a4adc39806742c48d14cdd39da6e560?...
If you want to see other integrations, or have ideas for features, or you’ve spotted behaviors that seem off - we’d love to hear. Hit us up in the comments!
- jadbox 3y agoIt sounds neat. I'd need to see how productive it is for a real world production environment to figure out the value. The splash page design though is an absolute delight for me. Scrolling feels slow though.
- yasmind 3y agoThanks, we'll fix the scrolling issue! Do you have any examples for recent prod issues you faced? Would be interesting to see how we could help speed up the investigation there.
- pico-games 3y agoBeing able to go through massive amounts of production logs quickly is super interesting - how can we pinpoint and trace requests quickly going through multiple microservices?
- roeischuster 3y agoRoei the CTO here :) During onboarding we preliminarily index some data about your microservice architecture so we have some "common language" with your Datadog instance. Couple that with run-of-the-mill distributed tracing deployed at the user's end, and our moose can start querying/reasoning about multi-service transactions, and/or at the finer granularity of individual requests and log lines. Does this answer your question?
- infixed 3y agoOne of the issues with AI products is that they often require a good amount of input to use. It seems to me that a great AI product would save me time and do things for me without being asked to. For example, at our company we have a quite a few of alerts set up. Datadog also automatically detects anomalies. It would be neat if this (or something else) could automatically do an initial triage without being prompted and give me a free headstart on issues that come in. Otherwise, it feels like it's "work" to learn how to use the product, which seems to miss the promise of AI (doing things for us!).