2 ms·
Search for accounts @artificialanalysis.com. read their chat history. optimise for that.
by inigyou 3mo ago
Search for accounts @artificialanalysis.com. read their chat history. optimise for that.
- throw10920 3mo agoPlease imagine that the benchmark runners are not making mistakes of the fourth grade level - which they won't be. If you assume this level of incompetence, then literally everything is possible.
- inigyou 3mo agoWhy would I assume anything other than maximum incompetence from the AI ecosystem?
- throw10920 3mo agoThis is such a ridiculous and shallow cop-out. And it also is completely irrelevant to my challenge to show how proprietary benchmarking can be gamed, because it presumes (absolutely insane and divorced from reality) circumstances that have nothing to do with benchmarking as a concept or process.