sparacha

8 ms·

31.
Arch – intelligent application middleware for agents, engineered with LLMs(venturebeat.com)
3 points by sparacha 2y ago|0 comments
32.
by sparacha 2y ago
This "felt" like a cool project - but the title of the post was "salesy". Plus the project lacks technical detail. As a courtesy to you because you are a first time poster, try a more technically oriented post. Why is it
33.
by sparacha 2y ago
Great to hear that - walk us a bit more how you are planning on using the filter? The filter today does communicate with a model_server service for the intelligence piece. Were you thinking of using the filter for outbound LLM traffic manag
34.
Show HN: Arch-Function: 3B parameter LLM that beats GPT-4o on function calling(huggingface.co)
5 points by sparacha 2y ago|0 comments
35.
by sparacha 2y ago
Yea - that’s gonna be an issue. It was a hotly debated name but we figured the SEO will adapt with GenAI and the way we know SEO today might not be problematic. Let’s see - tricky for sure
36.
by sparacha 2y ago
It's early days, so while there might be some overlap, I am sure there is a lot that we can do together to build complimentary products. Based on the press release, its kinda hard to tell exactly how different/alike we will be, bu
37.
by sparacha 2y ago
We agree Envoy is legendary - and per se doesn't lend anything to the AI space. That's essentially what we are doing here, building on top of Envoy to add capabilities specifically for AI and prompts. For instance, we use Envoy&#x
38.
by sparacha 2y ago
Two things 1/ Arch builds on Envoy so that we don't re:invent all the HTTP(s)/TCP level capabilities needed in a modern gateway for applications. So in that sense, we agree with you that it should "extend" something
39.
by sparacha 2y ago
That's a fair point - technically it protects the application from malicious attempts to subvert the desired LLM experience. The more specific language (and I think we could do better here) would be that Arch ensures users remain withi
40.
by sparacha 2y ago
Hey HN - my name is Salman and I am Adil’s Co-Founder. Would love to hear and get feedback. Here is a link to our public roadmap, please lets us know if there are things you’d like for us to work on first https://github.com/
41.
by sparacha 2y ago
Well, in the case of the front-end (like streamlit, gradio, etc) they send conversational messages in their own custom ways - this means I must develop against them each specifically, and that slows down any quick experimentation I would wa
42.
by sparacha 2y ago
Thanks - please leave us any feedback on github to make it better. We will share study results in about 30 days as we get more data from other users.
43.
Show HN: Open-source study to measure end user satisfaction levels with LLMs(open-llm-initiative.com)
12 points by sparacha 2y ago|2 comments