3 ms·
Overriding existing knowledge: I dropped this on a few LLMs: 35 people are aboard a sinking ship. The ship will take 45 minutes to sink. There is only one life
by schulzi 1mo ago
Overriding existing knowledge: I dropped this on a few LLMs:
35 people are aboard a sinking ship. The ship will take 45 minutes to sink. There is only one lifeboat which can hold 7 people. A round trip to the closest island takes the boat 11 minutes How many people can be saved?
Claude and Gemini got it right, the others all got it wrong first shot, some needed longer conversations to get it right, interesting to see their behaviour. Co-Pilot was very disappointing, ChatGPT needed several questions. Pi spun a great story around the incorrect result, then tried out several options, ending each with: Wait, that's not right or No, that's still not right. Pi and others got it wrong several times because they had a number in memory that they thought to be right, but preexisting knowledge that was wrong.