3 ms·

Pelican riding a bike here: https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e0563e8c1398eac655?permalink_comment_id=6128716#gistcomment-6128716 https://

Pelican riding a bike here: https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e0563e8c1398eac655?permalink_comment_id=6128716#gistcomment-6128716 https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e056... (ran this on arena.ai direct chat and also tried to write this gist inspired by how simon writes his gists about pelicans) Edit: just realized that I made pelican riding a bike instead of bicycle, which now makes sense as to why it hardened the bicycle to look tankier, going to compare this with pelican riding a bicycle if anybody else shares the pelican riding a bicycle.

gchamonlive 5mo ago
https://simonwillison.net/2025/Nov/13/training-for-pelicans-riding-bicycles/ https://simonwillison.net/2025/Nov/13/training-for-pelicans-... You should probably come up with variations, like a beaver riding a scooter or something, just to see what's what :)
- Imustaskforhelp 5mo ago
  Thanks I have generated both beaver riding a scooter: https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e0563e8c1398eac655?permalink_comment_id=6128738#gistcomment-6128738 https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e056... pelican riding a bicycle: https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e0563e8c1398eac655?permalink_comment_id=6128731#gistcomment-6128731 https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e056... Personal opinion but the beaver one looks especially bad as compared to pelicans. Can we be for sure that this model of grok-4.3 hasn't been trained on pelican. Simonw in blog-post says that he will try with other creatures so I hope he does that but it does feel to me as the model/xAI is trying to cheat, Hope Simonw tests it out more. Edit: Also added turtle riding a scooter, something which literally has images online or heck even teenage mutant ninja turtles and I thought that it would be able to pass this but it wasn't even able to generate this: https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e0563e8c1398eac655?permalink_comment_id=6128743#gistcomment-6128743 https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e056... This literally looks more avocado than turtle. Perhaps this could be a bug from arena.ai or something else too, not sure but at this point waiting for simon's analysis.
  - gchamonlive 5mo ago
    We can never be sure of course, but I think this is a very strong indication that pelican riding a bike is indeed going into the training dataset. Thanks for generating those!

gchamonlive 5mo ago

https://simonwillison.net/2025/Nov/13/training-for-pelicans-riding-bicycles/ https://simonwillison.net/2025/Nov/13/training-for-pelicans-... You should probably come up with variations, like a beaver riding a scooter or something, just to see what's what :)

Imustaskforhelp 5mo ago
Thanks I have generated both beaver riding a scooter: https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e0563e8c1398eac655?permalink_comment_id=6128738#gistcomment-6128738 https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e056... pelican riding a bicycle: https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e0563e8c1398eac655?permalink_comment_id=6128731#gistcomment-6128731 https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e056... Personal opinion but the beaver one looks especially bad as compared to pelicans. Can we be for sure that this model of grok-4.3 hasn't been trained on pelican. Simonw in blog-post says that he will try with other creatures so I hope he does that but it does feel to me as the model/xAI is trying to cheat, Hope Simonw tests it out more. Edit: Also added turtle riding a scooter, something which literally has images online or heck even teenage mutant ninja turtles and I thought that it would be able to pass this but it wasn't even able to generate this: https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e0563e8c1398eac655?permalink_comment_id=6128743#gistcomment-6128743 https://gist.github.com/SerJaimeLannister/f6de26bd0d0817e056... This literally looks more avocado than turtle. Perhaps this could be a bug from arena.ai or something else too, not sure but at this point waiting for simon's analysis.
- gchamonlive 5mo ago
  We can never be sure of course, but I think this is a very strong indication that pelican riding a bike is indeed going into the training dataset. Thanks for generating those!