this is a great point. do you know of any benchmarks doing this today? given the acute need to evaluate models on contextual factuality, we're exploring how t

this is a great point. do you know of any benchmarks doing this today? given the acute need to evaluate models on contextual factuality, we're exploring how to create a benchmark for this purpose but prefer existing benchmarks if possible. openai's truthfulqa[0] is close but does not focus on contextual factuality and targets a much harder problem of absolute truth. if none exist, and people are interested in contributing, please reach out. [0] https://github.com/sylinrl/TruthfulQA https://github.com/sylinrl/TruthfulQA