2 ms·
I know that tends to happen for LLMs but I don't know if Google/MS would care enough about some obscure benchmark system to try to game it.
by pants2 3y ago
I know that tends to happen for LLMs but I don't know if Google/MS would care enough about some obscure benchmark system to try to game it.
- calamari4065 3y agoTheir entire business is gaming metrics. Most of those metrics are ones they invented for themselves, but if there's any advantage at all, they'll game it