39 ms·
First model to get 100% on my agentic benchmark: https://sql-benchmark.nicklothian.com/?highlight=anthropic_claude-opus-4.7 https://sql-benchmark.nicklothian.co
by nl 6mo ago
First model to get 100% on my agentic benchmark: https://sql-benchmark.nicklothian.com/?highlight=anthropic_claude-opus-4.7 https://sql-benchmark.nicklothian.com/?highlight=anthropic_c...
- b--l 6mo agogrok-4.1-fast is the the number 2 model on this benchmark. ~~If you've used this model in real life to do any sort of programming, and have seen its output, you would know that there is something VERY wrong with your benchmark.~~ Edit: Oh sorry, I looked at the questions, I see this is also for SQL specifically. Interesting. Maybe they tuned that grok model for SQL. Cool site. I bookmarked it.
- nl 6mo agoYeah, multi-step SQL generation and debugging. Some models surprised me and Grok Fast was one of them. It is consistently good at this task though!