4 ms·
Ragas also has a feature to generate ground truths and queries: https://docs.ragas.io/en/latest/getstarted/testset_generation.html https://docs.ragas.io/en/late
by michalf6 2y ago
Ragas also has a feature to generate ground truths and queries: https://docs.ragas.io/en/latest/getstarted/testset_generation.html https://docs.ragas.io/en/latest/getstarted/testset_generatio...
Although simply prompting an LLM with chunks of source documents might work better / cheaper - ragas tends to explode with retries in my experience.
- kaushik92 2y agoI have seen this, but I find it fairly hard to use. Our goal is to focus on datasets and make it very easy to create and manage data. In our next release, we will be launching a way to do this using a UI.