Another thing you can try which is readily testable is Pokémon. So in the Pokémon games, different Pokémon have different stats, for example attack, defence, s

Another thing you can try which is readily testable is Pokémon. So in the Pokémon games, different Pokémon have different stats, for example attack, defence, speed, and so on. I would ask gpt to list in a table pokemon with more than a specific amount in a stat like >150 attack for example. It routinely can print Pokémon in a table that matches the criteria, but it misses some out or includes wrong ones. When you point it out it agrees with you and will try to reprint the table but each time there are some errors, missing Pokémon, Pokémon incorrectly added. The dataset is very well known so it’s a good benchmark of correctness. Example: https://pokemondb.net/pokedex/all https://pokemondb.net/pokedex/all This was in gpt3.5