4 ms·
They ran lm-evaluation-harness on both this model and the original llama weights, which is the correct way to do it. Many people have been struggling to reprod
by byefruit 3y ago
They ran lm-evaluation-harness on both this model and the original llama weights, which is the correct way to do it.
Many people have been struggling to reproduce the benchmark numbers included in the original llama paper.