3 ms·
Can you explain why you wouldn't want to use it, i.e. what data contamination is?
by triyambakam 3y ago
Can you explain why you wouldn't want to use it, i.e. what data contamination is?
- 0xDEADFED5 3y agocontamination: training on the questions/answers used for LLM benchmarks. the top of the HuggingFace Open LLM leaderboard was pretty meaningless for a bit because many of the top scores were achieved by training on the evaluation data