2 ms·
I'm not sure why you felt the need to link that. I'm aware of it as well as that GPT-4 isn't on the list and that the top is a LLaMA tuned model. But I'm not go
by godelski 3y ago
I'm not sure why you felt the need to link that. I'm aware of it as well as that GPT-4 isn't on the list and that the top is a LLaMA tuned model. But I'm not going to get into the rabbit hole of the difficulties of evaluation. Especially when arena exists due to this difficulty and even writes about such. We're going to just have to agree to disagree I guess because I'm not going to agree that there's a definitive singular metric that determines "best." The intrinsic flaws I'm discussing are well known in the research community and not something we really debate about. That only seems to happen when discussing in more public settings.