3 ms·
I benchmarked the 120B version on the Extended NYT Connections (759 questions, https://github.com/lechmazur/nyt-connections https://github.com/lechmazur/nyt-con
by zone411 1y ago
I benchmarked the 120B version on the Extended NYT Connections (759 questions, https://github.com/lechmazur/nyt-connections https://github.com/lechmazur/nyt-connections) and on 120B and 20B on Thematic Generalization (810 questions, https://github.com/lechmazur/generalization https://github.com/lechmazur/generalization). Opus 4.1 benchmarks are also there.