I just tried variations and weirdly it fails many of them like: "bob has 7 sisters, each sister has 4 brothers. How many brothers does bob have?" ------------

I just tried variations and weirdly it fails many of them like: "bob has 7 sisters, each sister has 4 brothers. How many brothers does bob have?" ----------------- Llama 70b instruct (wrong) A classic lateral thinking puzzle! At first glance, it seems like a straightforward math problem, but wait... If each of Bob's 7 sisters has 4 brothers, that would mean each sister has Bob and 3 other brothers, right? But that's not possible, because Bob is the only brother! So, the correct answer is: Bob has no brothers. He has 7 sisters, and each of them has him as their only brother. Did I get it right? ----------------- GPT-4 (correct) To solve this, let's consider the family structure: Bob has 7 sisters. Each of these sisters has 4 brothers. Since all the sisters have the same number of brothers, and these brothers include Bob, this implies Bob has 3 other brothers. Therefore, including Bob, there are 4 brothers in total. Hence, Bob has 3 brothers.