this reminds me of the whole situation with how llms cannot really solve logic problems, they only really memorized the answer, for example the riddle: a mothe

this reminds me of the whole situation with how llms cannot really solve logic problems, they only really memorized the answer, for example the riddle: a mother and her son got in a car accident, the mother died, and the son was driven to the hospital. the doctor (who is the boy's father) says he cannot opperated because he is related to the boy. what is the relation between the boy and the doctor. llms like to assume the doctor is the mother because of the fact that is the version that shows up in their training data.