almogbaku

4 ms·

1.
by almogbaku 6mo ago
Hi @RoiTabach, OP here Yep. We can integrate with every solution that supports OpenTelemetry :) so it's pretty native, just use the integration skill npx skills add kelet-ai/skills
2.
by almogbaku 6mo ago
Hi @BlueHotDog2, OP here langsmith/langfuse/braintrust collect traces, and then YOU need to look at them and analyze them(error analysis/RCA). Kelet do that for you :) Does that make any sense? If not, please tell me, I'
3.
by almogbaku 6mo ago
Hi @halflife, OP here YEP, Good catch! Kelet as input/prompt in Hebrew :)
4.
by almogbaku 6mo ago
Hi @hadifrt20, OP here From what we discovered analyzing ~33K+ sessions, most of the time when the agent selects the wrong tool, it's because the tool's description (i.e., prompt) was not good enough, or there's a missing nua
5.
by almogbaku 6mo ago
Hi @jldugger Great points, but I think there's a domain confusion here . You're describing infra/code RCA. Kelet does an AI agent Quality RCA — the agent returns a 200 OK, but gives the wrong answer. The signal space is diffe
6.
by almogbaku 6mo ago
hey @dwb, OP here Yes. I definitely assisted LLM in writing it. Yeah - I should have stripped it better. Yet it's f*ing painful to do error analysis and go through thousands of traces. Hope you can live with my human mistakes
7.
Show HN: Kelet – Root Cause Analysis agent for your LLM apps(kelet.ai)
47 points by almogbaku 6mo ago|24 comments
8.
Show HN: Stop AI Debugging with Print(). Use a Debugger(github.com)
2 points by almogbaku 7mo ago|0 comments
9.
by almogbaku 7mo ago
This is so funny, i've been working on my HN post for the past hour, then i saw this :) Anyway, in practice, I saw it go from 5-6 print-debug cycles down to 1-2 targeted stops. I built a small CLI that wraps the Debug Adapter Protocol
10.
Compile ML engineering to production code(github.com)
2 points by almogbaku 11mo ago|0 comments
11.
by almogbaku 2y ago
Yeah, pytest-harvest is a pretty cool plugin. Originally I had a (very large and unfriendly) conftest file, but it was quite challenging to collaborate with other team members and was quite repetitive. So I wrapped it as a plugin, added som
12.
by almogbaku 2y ago
Hey HN! Creator here. I recently found myself writing evaluations for actual production LLM projects, and kept facing the same dilemma: either reinvent the wheel or use a heavyweight commercial system with tons of features I don't need
13.
Show HN: Pytest-evals – Simple LLM apps evaluation using pytest(github.com)
13 points by almogbaku 2y ago|3 comments
14.
by almogbaku 4y ago
Lol that's pretty funny. But the UI is a bit unclear
15.
by almogbaku 5y ago
This is the weirdest code documentation I have ever read.
16.
by almogbaku 5y ago
this is pretty cool to see how he predicted some things pretty good
17.
by almogbaku 11y ago
looks really interesting. thanks for sharing
18.
by almogbaku 11y ago
Looking really cool.. Although it's not fair to compare sf2 to rails (which ruling the ruby world.......)
19.
by almogbaku 12y ago
Awesome article! That's a very interesting subject.. And it reminds me Jekyll a little bit- but with UI :O
20.
by almogbaku 12y ago
cool
21.
by almogbaku 12y ago
Great article from SocialBelong Co-Founder