3 ms·
Given the context, it appears they are not benchmarking against other models but comparing differently sized versions of the same model. The 8B one is just the
by sigmoid10 2y ago
Given the context, it appears they are not benchmarking against other models but comparing differently sized versions of the same model. The 8B one is just the one they decided to give a catchy name. The other ones are probably also just fine tuned Llama models. But without information on the total compute budget (i.e. nr. of trained tokens), this kind of plot is pretty useless anyways.