3 ms·
They leak the second they are used on a model behind an API, don't they?
by chvid 2y ago
They leak the second they are used on a model behind an API, don't they?
- chvid 2y agoAs far as I can tell the only way of doing a comparison of two models, that cannot be easily gamed, is being having them in open weights form and then running them against a benchmark that was created after both of the two models were created.