So interestingly if you are more explicit all of the models reliably answer correct. The confusion is clearly whether Alice is included as a sister in the count

So interestingly if you are more explicit all of the models reliably answer correct. The confusion is clearly whether Alice is included as a sister in the count of sisters. By stipulating the prompt with “not including herself” it sufficiently disambiguates the problem and most LLMs get it right.