varunkrishnan17

4 ms·

1. 1.▲
   Show HN: RL Agent that can auto-optimize your LLM prompts(nomadic-ml.github.io)

   14 points by varunkrishnan17 2y ago|2 comments
2. 2.▲
   by varunkrishnan17 2y ago

   Really appreciate it Jadiker! We're obviously in a similar space, but we think we offer some strong differentiators: (1) Functionality that is more specific to your LLM use cases (for example, being able to easily kick off a RAG Retrie
3. 3.▲
   by varunkrishnan17 2y ago

   Thanks for the well-thought out question Jadiker! This is a potential limitation of N-gram precision with context matching, which we were using in the RAG demo for simplicity (though even with this, I don't think it would be so extreme
4. 4.▲
   by varunkrishnan17 2y ago

   That's a great use case of Nomadic! We support many Eval frameworks in the optimization, but one is a LLM-as-a-Judge model, where you can input custom weights based on your metrics of interest! Adhering to a proper structure could be
5. 5.▲
   by varunkrishnan17 2y ago

   Hi I'm Varun - one of the cofounders of Nomadic! Been a pleasure to work with Mustafa and Lizzie on this! Hopefully you can solve a pain point I personally have had for so long - how can you easily verify that your model continues to p