2 ms·
It's pretty hilarious how I've come to trust this benchmark for a gut check on frontier models more than any of the numbers available. It seems to map perfectly
by ramesh31 1y ago
It's pretty hilarious how I've come to trust this benchmark for a gut check on frontier models more than any of the numbers available. It seems to map perfectly to codegen abilities. Based on the pelicans, Grok 4 looks somewhere around Claude 3.7 levels.