I build a system to do exactly this: https://docs.kiln.tech/docs/evaluations/evaluate-rag-accuracy-q-and-a-evals https://docs.kiln.tech/docs/evaluations/evaluat

I build a system to do exactly this: https://docs.kiln.tech/docs/evaluations/evaluate-rag-accuracy-q-and-a-evals https://docs.kiln.tech/docs/evaluations/evaluate-rag-accurac... Basically it: - iterates over your docs to find knowledge specific to the content - generates hundreds of pairs of [synthetic query, correct answer] - evaluates different RAG configurations for recall