Great article! Now what would happen if we took this idea, and turned it on it's head? Let's train a model to consistently give an answer first, and have it inf

Great article! Now what would happen if we took this idea, and turned it on it's head? Let's train a model to consistently give an answer first, and have it infer the steps it took to get there after. ... Is what I think the researchers at mistral AI are saying, because that's what they did. Every slightly complex question you ask their models goes somewhat like this: >Input: Alice has 3 brothers. Each of her brothers has 2 sisters. How many sisters does Alice have? >Output: Alice has 2 sisters. >Here's the reasoning: > We know that Alice has 3 brothers. > Then we are told that each of her brothers has 2 sisters. > Since Alice is one of the sisters to her brothers, there must be one more sister besides Alice for each brother to have 2 sisters. > Therefore, Alice has 2 sisters in total. Conversely, if you ask the model to think first, it gets it right immediately. I'm kinda baffled, they have not corrected this after their very first model. From mistral 7b to large, each one shows this same trained behavior to answer first, think second.