vercantez

6 ms·

1. 31.▲
   by vercantez 1y ago

   Thanks for catching that! Should be fixed once the cache invalidates
2. 32.▲
   Show HN: Chat with 19 years of HN(app.camelai.com)

   156 points by vercantez 1y ago|124 comments
3. 33.▲
   by vercantez 2y ago

   > Limit additional context in retrieval-augmented generation (RAG): When providing additional context or documents, include only the most relevant information to prevent the model from overcomplicating its response. This databricks blog&
4. 34.▲
   OpenAI reasoning models: Advice on prompting(simonwillison.net)

   1 points by vercantez 2y ago|1 comments
5. 35.▲
   Show HN: CamelAI – Perplexity for Your Data(camelai.com)

   3 points by vercantez 2y ago|1 comments
6. 36.▲
   by vercantez 2y ago

   Wish they explained how they perform targeted edits. Is it doing speculative decoding like Anthropic’s code edit or something like Aider’s diff format?
7. 37.▲
   by vercantez 2y ago

   This is impressively fast. Well done!
8. 38.▲
   by vercantez 3y ago

   We originally spelled it qaml which stood for quality assurance, machine learning. That wasn't obvious to anyone and everyone would pronounce it as "qwamel" which we hated so we decided on camelQA instead. Thanks for the ques
9. 39.▲
   by vercantez 3y ago

   Thanks! Yes inference costs are non-negligible right now but we think this will come down over time
10. 40.▲
    by vercantez 3y ago

    Thanks! Web app support is coming very soon. That would be a really cool application of the API
11. 41.▲
    by vercantez 3y ago

    Thanks! We are releasing an API soon along with some common CI/CD pipeline integrations. We're working hard on speeding tests up so that we don't slow down your pipeline.
12. 42.▲
    by vercantez 3y ago

    Wow thanks! We're only able to build this because of tools like Appium. Thanks for all of your contributions to this space.
13. 43.▲
    by vercantez 3y ago

    The issue with this approach is that for all but the most simple apps it is not possible to deduce the runtime element information needed to write traditional UI tests given just the source code. This can only be done reliably at runtime wh
14. 44.▲
    by vercantez 3y ago

    1. The AI agent writes an automation script (similar to Appium) that we can replay after the first successful run. If there are issues the AI agent gets pulled back into the loop. 2. You can define acceptance criteria in natural language wi
15. 45.▲
    by vercantez 3y ago

    Thanks! Yes, we experimented with that! I think because of the way that GPT sees images in patches it has a hard time with absolute positioning but that's just a guess.
16. 46.▲
    by vercantez 3y ago

    Great questions. 1. Yes, running tests in parallel helps. We also cache actions so subsequent runs are much faster (this is disabled in the demo). 2. I agree that testing can be much more reliable and pleasant in some codebases than others.
17. 47.▲
    by vercantez 3y ago

    GPT-4V is great for reasoning about what is on the screen. However, it struggles with precision. For example, it is not able to specify the coordinates to tap when it decides to tap an icon. That's where the object detection and access
18. 48.▲
    by vercantez 3y ago

    Good questions. Execution cost is indeed higher than traditional testing automation scripts but much lower than the human cost of writing and maintaining the scripts. We're starting at $500/month and our plans go up from there dep
19. 49.▲
    by vercantez 3y ago

    Thanks for the feedback! We'll add some styling to the demo page. We're processing the image with an object detection model and classification model and also using some accessibility element data to get a better understanding of w
20. 50.▲
    Launch HN: CamelQA (YC W24) – AI that tests mobile apps

    141 points by vercantez 3y ago|54 comments
21. 51.▲
    by vercantez 3y ago

    Cool idea. Is there any way to steer the image generation? I couldn't find any way to. (p.s. site is pretty slow right now. not sure if that's due to high load or something)
22. 52.▲
    by vercantez 3y ago

    Oh this is really cool! Since the repl is just executing wasm, could this not work in the browser? I realize you'll probably need to create a new wasm module every time you run a statement but could still be neat!
23. 53.▲
    Show HN: Mobile Safari Article Summarizer(gettldr.app)

    1 points by vercantez 3y ago|0 comments
24. 54.▲
    by vercantez 3y ago

    Brian Cantrill is a legend. We're gonna need a sequel to https://www.youtube.com/watch?v=tDacjrSCeq4 . Very happy to see them ship.