3 ms·
I don't think that's really relevant, because there is an actual need for a new benchmark given how the existing ones either keep getting saturated or are proba
by sebzim4500 2y ago
I don't think that's really relevant, because there is an actual need for a new benchmark given how the existing ones either keep getting saturated or are probably out of the reach for the next generation of models.
The closest existing thing is the frontierAI benchmark but that's just maths whereas this is more diverse.