pranshuchittora

4 ms·

31.
Ask HN: How are you using AI agents for testings features?
1 points by pranshuchittora 4mo ago|1 comments
32.
by pranshuchittora 4mo ago
Yes, I feel so. I started happening from june first weekish. I have shifted to claude code for planning things and codex for execution (as it is faster, though dumb)
33.
by pranshuchittora 4mo ago
Yes - https://github.com/vostride/agent-qa
34.
by pranshuchittora 4mo ago
Use https://github.com/vostride/agent-qa you don't need a QA team just ask coding harness to write tests and you can review the test runs.
35.
by pranshuchittora 4mo ago
Yes a lot. So with the acceleration of AI in the software engineering. Features are being shipped faster but causes regressions. The only way to verify is either you write tests with AI and spend hours reviewing them or you do manual QA. ag
36.
by pranshuchittora 4mo ago
Try the OSS alternative - https://github.com/vostride/agent-qa
37.
by pranshuchittora 4mo ago
Try the OSS alternative - https://github.com/vostride/agent-qa
38.
by pranshuchittora 4mo ago
Try the OSS alternative - https://github.com/vostride/agent-qa
39.
by pranshuchittora 4mo ago
Try the OSS alternative - https://github.com/vostride/agent-qa
40.
by pranshuchittora 4mo ago
I did. Checkout the OSS alternative - https://github.com/vostride/agent-qa
41.
by pranshuchittora 4mo ago
Try the OSS alternative - https://github.com/vostride/agent-qa
42.
by pranshuchittora 4mo ago
Some digging FAST_MODEL = "google/gemini-3-flash" (fast mode primary) DEEP_MODEL = "openai/gpt-5.4" (deep mode primary) VISION_CLICK_MODEL= "openai/gpt-5.4" (
43.
by pranshuchittora 4mo ago
Hey, I just gave it a try and ran a quick test on booking.com. It took ~3 mins for a basic test. Do you cache the test steps so that future runs are faster and they don't call LLMs for the subsequent runs? Also your current pricing is
44.
by pranshuchittora 5mo ago
The word dictionary is curated with guardrails. Also the dictionary contains words which are 1 BPE token long. Under 5-6 characters
45.
by pranshuchittora 5mo ago
Thanks for those kind words. The landing page's demo required lots of sculpting. I would say that agent-qa is not only frontend focused. As you can run hooks in sandboxed env to test apis, so a better way to put it is with agent-qa you
46.
Show HN: Open-Source Agentic QA Harness with Memory(vostride.com)
18 points by pranshuchittora 5mo ago|2 comments
47.
by pranshuchittora 5mo ago
It is being used in production at https://vostride.com/agent-qa The issues was agent-qa have many different kinds of files tests, memory etc and there's too much FK references which LLMs need to resolve. Using id-agent
48.
by pranshuchittora 5mo ago
V1StGXR8_Z5jdHi6B-myT 21 Characters, 14 Tokens Really really inefficient
49.
by pranshuchittora 5mo ago
Yes, we have the validation methods to verify the output. https://github.com/vostride/id-agent/#validateid A random "-" separated words will fail the validation check.
50.
by pranshuchittora 5mo ago
Looks like it ;)
51.
by pranshuchittora 5mo ago
LLMs are good at predicting words, since each word in the id is ~1 BPE token. But uuids are random hex characters, this is where LLMs struggle to output the right ids. You can use the .from method https://github.com/vostrid
52.
by pranshuchittora 5mo ago
No worries, Checkout https://vostride.com/agent-qa to see how we are using this in production.
53.
by pranshuchittora 5mo ago
Kinda similar, but this is token efficient. Each word is ~1 BPE token
54.
by pranshuchittora 5mo ago
Would love to, can you please create an issue on the GH repo.
55.
by pranshuchittora 5mo ago
Using "_" separator increases the token usage.
56.
by pranshuchittora 5mo ago
Yes, that a valid point. That's why we have a verification method which can be part of the harness to make sure the ids are not hallucinated.
57.
Show HN: Id-agent – Token efficient UUID alternative for AI agents(github.com)
42 points by pranshuchittora 5mo ago|55 comments
58.
by pranshuchittora 5mo ago
This is what teams are doing today. But LLMs have a tendency to greedily write tests, which leads to hacky tricks to make the test succeed. agent-qa is a harness where playwright works as an execution kernel and LLM works as a observer, pla
59.
by pranshuchittora 5mo ago
Do give it a try https://vostride.com/docs/agent-qa/quickstart
60.
by pranshuchittora 5mo ago
Yes, https://vostride.com/docs/agent-qa/configuration/global-conf...

More ›