3 ms·
I don’t know what you mean by “too research oriented.” A common complaint in LLM research is the poor quality of evaluation metrics. There’s no consensus. Every
by Q6T46nT668w6i3m 3y ago
I don’t know what you mean by “too research oriented.” A common complaint in LLM research is the poor quality of evaluation metrics. There’s no consensus. Everyone wants new benchmarks but designing useful metrics is very much an open problem.
- p1esk 3y agoI think he wants to limit evaluations to the most frequent question types seen in the real world.