To an extent, but different models are better at different things. That is something I'm also curious about. Given models (that use the same tokenisation) tha

To an extent, but different models are better at different things. That is something I'm also curious about. Given models (that use the same tokenisation) that are better at different things, would their be interesting things to find by analysing the logprobs for tokens generated from identical inputs (including cross feeding the generated token from one to another) Surely there must be something notable at particular points when a model goes off on the wrong path.