4 ms·
Someone tested this, and it doesn't look to be saturated. https://dylancastillo.co/posts/pelicanmaxxing.html https://dylancastillo.co/posts/pelicanmaxxing.html
by crimsoneer 23d ago
Someone tested this, and it doesn't look to be saturated.
https://dylancastillo.co/posts/pelicanmaxxing.html https://dylancastillo.co/posts/pelicanmaxxing.html
Simon made I think a very good argument for why it's still useful, if not the most robust benchmark in the world.
https://simonwillison.net/2026/Jul/16/kimi-k3/ https://simonwillison.net/2026/Jul/16/kimi-k3/
- kaoD 23d ago> Someone tested this, and it doesn't look to be saturated. They could still pelicanmaxxing but the RL for "pelican riding a bicycle" does incidentally improve "<animal> <verb> <vehicle>". Or they could've predicted someone would check if they're pelicanmaxxing or the benchmark would switch eventually, so they preemptively RL'd a mixture of animals and vehicles.