I've found that for tasks like this you need to ask the model to output its reasoning prior to outputting the "answer". See "chain of thought" e.g https://arx

I've found that for tasks like this you need to ask the model to output its reasoning prior to outputting the "answer". See "chain of thought" e.g https://arxiv.org/abs/2201.11903 https://arxiv.org/abs/2201.11903