zammitjames

4 ms·

1. 1.▲
   by zammitjames 2y ago

   That’s a great point! While we do our best to simulate an identical case, if the agent responds differently, our focus is on whether the key evaluator or goal for that replay set passes or fails. We use that as the source of truth and flag
2. 2.▲
   by zammitjames 2y ago

   We help capture discrepancies between your transcription model and errors in order to effectively calculate a Word Error Rate (WER) as part of your evaluation process. Post-call transcription tends to be more accurate, and we’ve seen teams
3. 3.▲
   by zammitjames 2y ago

   Great question! Roark is named after Ted Roark from Chuck — both of us (Daniel and I) watched Chuck a lot growing up, and the name just stuck with us. No deep meaning, just something we liked and thought sounded cool!
4. 4.▲
   by zammitjames 2y ago

   Thank you!
5. 5.▲
   by zammitjames 2y ago

   Great question! Most teams deploying voice AI do have testing and QA flows, but they’re often manual, brittle, or incomplete. Unlike traditional software, voice agents don’t have structured inputs and outputs — users phrase things unpredict
6. 6.▲
   by zammitjames 2y ago

   Great question! There’s been a lot of movement in this space, but most existing solutions focus on simulation-based testing—generating synthetic test cases or scripted evaluations. Roark takes a different approach: we replay real production
7. 7.▲
   by zammitjames 2y ago

   Appreciate the feedback! To clarify, Roark isn’t handling authentication itself - it’s a testing and observability tool to help teams catch when their AI fails to follow expected security protocols (like verifying identity before sharing se
8. 8.▲
   by zammitjames 2y ago

   Thanks, Jan! Would love to hear more about what you’re working on! Just sent you an email.
9. 9.▲
   by zammitjames 2y ago

   Appreciate the feedback! Completely agree - authentication should be handled at the system level, not just in prompts. This demo is meant to showcase how teams can build test cases from real failures and ensure fixes work before deployment.
10. 10.▲
    Launch HN: Roark (YC W25) – Taking the pain out of voice AI testing

    60 points by zammitjames 2y ago|29 comments
11. 11.▲
    Ask HN: Home Automation Startup Idea

    1 points by zammitjames 6y ago|3 comments
12. 12.▲
    by zammitjames 10y ago

    Thank you so much for your tip! Maybe I should have shared this instead: https://www.youtube.com/watch?v=1QDZJcnLATI
13. 13.▲
    Show HN: Kwaver – Music Collaboration App(youtube.com)

    2 points by zammitjames 10y ago|0 comments
14. 14.▲
    by zammitjames 10y ago

    thank you!
15. 15.▲
    by zammitjames 10y ago

    Hi! Thanks for your feedback! We'll get right on it :)
16. 16.▲
    Kwaver – Music Collaboration App

    1 points by zammitjames 10y ago|6 comments
17. 17.▲
    by zammitjames 10y ago

    Kwaver - Change the way music is born. - Music Collaboration App - https://kwaver.com
18. 18.▲
    Kwaver – Music Collaboration App(kwaver.com)

    2 points by zammitjames 10y ago|0 comments
19. 19.▲
    Y Combinator – Kwaver – Music Collaboration App

    3 points by zammitjames 10y ago|0 comments
20. 20.▲
    Kwaver – Music Collaboration App(kwaver.com)

    1 points by zammitjames 10y ago|0 comments
21. 21.▲
    by zammitjames 10y ago

    We were part of the Early Access Program for the expanded Firebase and used it to build our music collaboration app Kwaver. With the new features, they did a nice job of collecting a bunch of related mobile products (Analytics, Push Notific